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ABSTRACT 


The major purpose of this research was to develop a method of 
measuring and recording ave movements of subjects during various 
learning tasks. It was required that the method developed for this 
purpose record simultaneously, as many oculographic characteristics as 
possible, relatively unobtrusively, with no mechanical attachments 
and with minimum of constraints placed on the subject. It was also 
required that the recording speed and sensitivity be sufficient to record 
all conjugate eye movements in a form readily accessible for computer 
analysis. 

The infrared computer based oculometer system developed consisted 
of an infrared television camera interfaced with a small computer. The 
eye of the subject was illuminated with infrared light, and an image of 
the eye was projected to the face of the infrared television camera. 
The small computer was used to monitor the video signal coming from 
the infrared camera via a specially designed interface unit, and to 
derive and store once every thirtieth of a second, both the pupil 
dilation and the displacement of the corneal reflection from the pupil 
center. Analysis of this data to determine and plot eye pointing 
coordinates was carried out off line, using an IBM 360/67 computer. 
This study describes and documents the development Ge ee infrared 
computer based oculometer system. 

Operating characteristics of the infrared computer based 
oculometer are discussed in terms of possible sources of error and in 


terms of accuracy of the system. 
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The performance of the infrared computer based oculometer was 
tested using a small number of subjects viewing a variety of stimulus 
situations. Plots of observed eye movements in relation to the stimulus 
Situations are presented in this study. 

Finally, a number of recommendations for improving the infrared 
computer based oculometer system are presented. Also further studies 
of eye movement meaSurements are recommended to enable additional 


analysis of error components inherent in the measurements. 
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CHAPTER «1 
INTRODUCTION 


The process of learning relies primarily upon sensory information 
reaching the learner via either or both the auditory and visual channels. 
While some occasions arise when sensory inputs from the tactile channel 
are also important to learning, it is much less often that the learner 
relies upon the remaining senses. 

Considering the relative importance of the auditory and visual 
sensory input channels, it is difficult to determine which of these 
“-is more important in learning. A great deal would most certainly 
depend on the nature of the learning task. Feinstein (1970) identified 


si our primary sensory input channel". 


the visual channel as 

Considering types of learning that depend on appropriate stimula- 
tion of the visual channel, if appropriate stimulation of the visual 
channel is dependent upon visual response, then one of the factors that 
affects learning is visual response. It is important therefore that 
studies of learning involving the visual sensory channel take into 
account the visual response of the learner. 

Educators have recognized the importance of the visual response 
(eye movements) in learning for nearly a century. The earliest eye 
movement studies were conducted in relation to reading (Javal, 1879) 
and consisted of directly observing and recording the movements of a 
subject's eyes while reading. One of the most significant discoveries 
that resulted from this early research was that in reading a line of 
text, the eye moves in a series of rapid jerks, (called saccades) 


interspersed with relatively long pauses (called fixations). This 
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discovery replaced the previously held traditional belief that when a 
person reads, his eyes move smoothly and uninterruptedly along the line 
of print. Tinker (1965) reported that rescarch activa ty. Worithis areca 
became more vigorous after 1900. He indicated that several hundred 
investigations of eye movements in relation to reading have been 
reported and ". ... have contributed much to an understanding of how 
children ‘learn’ to “read." 

The growth of technology during the twentieth century brought 
about many developments and improvements in methods of measuring and 
recording eye movements (oculography). By 1971, there were reports 
(Feinstein, 1970) of as many as seven different methods of oculography 
and each method included a number of variations in technique. During 
this same time period, interest in oculography began to spread to a 
varicty of other disciplines, including ophthalmology, biomedical 
engineering, and psychology. Within education, eye movement research 
spread to a number of other related fields, including studies of 
learning in’relation to novelty of a stimulus (Berlyne, 1958), familiarity 
and complexity of a stimulus (Neisser, 1964), size of a visual display 
(Enoch, 1959), attention (Guilford and Hackman, 1936), problem solving 
(Teichener and Price, 1966), emotionalism (Luborsky, Blinder and 
muekwaerne 1963) and perception and information-processing (Hebb, 1949; 
Gould and*Schaffter,' 1965). 

Another result of the growth of technology has been an increase 
in the importance of the visual sensory input channel in the field of 
education. The qevatspmere of offset printing and the subsequent mass 


distribution and utilization of books by educational institutions; the 


development of programmed instruction; the introduction of films, trans- 
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3 
parencies and educational television into the classroom; the introduction 
of special education for deaf children and mentally retarded; and most 
recently, the introduction of computer based instruction all rely 
heavily on Sensory input to the learner via the visual channel. 

Instructors responsible for constructing educational materials 
have relied to a large extent on the generalized findings that have 
come out of eye movement studies to guide them in designing visual 
instructional materials. However, frequently there is little similarity 
between the experimental setting and the educational setting to which 
generalizations must be drawn. Because most oculography equipment 

currently available does not readily lend itself to use outside the 
laboratory, instructors have had no way of evaluating the adequacy of 
their instructional materials to elicit appropriate visual responses. 
For example, in an experiment conducted by Wolf, et al. (1970) students 
were presented with a television scene of an instructor demonstrating the 
operation of a model airplane. Low IQ students tended to look at the 
instructor's tie rather than at the model airplane the instructor was 
demonstrating. This visual response would suggest that the instructor 
had failed to accomplish the stimulation of the visual channel that he 
had set out to bring about when he designed the scene. Improvement in 
visual response and perhaps in learning may be brought about by re- 
designing existing educational material. 

The first purpose of this study is to report and document the dev- 
elopment of the infrared computer based oculometer designed for monitoring 
and recording eye pointing coordinate data and pupil dilations of subjects 
involved in various learning tasks. The unique features of the computer 


based infrared oculometer are that it will operate under most normal 
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4 
lighting conditions, and that it will require only a minimum of physical 
restraint of the subject (chin rest). In addition, it will output data 
onto 9-track magnetic computer tape that will permit calculation of 
eye position, eye pointing direction and pupil dilation once every 
33.3 milliseconds. This will permit data to be easily analyzed. 

The data recorded by the infrared computer-based oculometer 
system will simply consist of a measure of pupil dilation and a 
measure of the displacement of the center of the corneal reflection 
from the pupil center, recorded once every thirtieth of a second. In 
order to derive the more traditional measures of eye movement such 
as number of fixations per line of text, mean length of fixation,’ 
number of blinks per unit time, etc., further processing of the 
oculometer output will be necessary. However, because the oculometer 
output will be available on 9-track computer tape, it will be 
relatively Bhp to prepare computer programs that will quickly 
read the oculometer output tape and output summaries of these more 
traditional eye movement measures. 

A second purpose of this study is to document the reliability, 
validity, and accuracy of the infrared computer based oculometer. This 
will be referred to as establishing the proof of performance of the 
system. This problem is essentially a measurement problem and is 
necessary when any new measuring instrument is developed. 

One way of establishing the proof of performance (reliability, 
validity and accuracy) of a measuring instrument is to compare the 
output of the system under test with the output of other systems 


whose proof of performance is already well established. This approach 
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was not used with the infrared computer based oculometer for several 
reasons. First, it is difficult to obtain a system with established 
proof of performance to Bowie the necessary data to be collected. 
Second, it is difficult, although possible, to configurate hardware 
so that two systems, the standard and the system under test, could 
simultaneously monitor a subject's eye movements. Most important 
however, it is expected from the design parameters of the infrared 
computer based oculometer, that its reliability and accuracy will 
exceed the reliability and accuracy of most known available systems. 
This would mean that determination of accuracy and reliability by 
‘comparison would have questionable merit. 

An alternative method of establishing proof of performance of 
the computer based oculometer system, and the one that will be followed 
in this study consists of documenting the performance of the infrared 
computer based oculometer system in relation to a series of simple, 
definable sub-tasks which are known to constitute the overall task 
that the system is expected to perform. These findings can then be 
generalized to describe the performance of the complete oculometer 
system. For example, since the capability of the oculometer to 
determine where a subject is looking is based on its capability to 
measure linear displacement (both horizontal and vertical) between 
two defined points within the image of the eye, one sub-task of the 
system is to measure small linear distances. Inadequate performance 
of the infrared computer based oculometer system while measuring small 
linear horizontal and vertical distances would certainly be one limita- 


tion of its capability to determine where a subject is looking. Chapter 
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three of this study includes the identification of other sub-tasks, 
and documentation of the performance of the infrared computer based 
oculometer in relation to these sub-tasks, and in turn, in relation to 
the main task of determining where a subject is looking. 

This study will also demonstrate the use of the infrared computer 
based oculometer for analyzing eye movements during learning by recording 
and analyzing the eye movements of a small number of subjects involved 
in three different types of learning tasks. The learning tasks will be 
selected from available instructional material in the Division of 
Educational Research Services and will be displayed on the cathode ray 
screen of an IBM 1500 CAI terminal. The displays will include one dis- 
play consisting of text only, one display consisting of some text 
combined with an illustration and one display consisting of a multiple 


choice question which requires the subject to select a response visually. 


Summary 


This chapter discussed the importance of the visual sensory 
input channel to learning and education and discussed the importance 
of knowing where the learner is looking during various learning tasks. 
Visual response of learners can be used as a basis for improving visual 
instructional materials. This chapter also identified the problems to 
be investigated in this study. 

Chapter two of this study will describe the various methods that 
have been developed for monitoring and recording eye movements and will 
discuss some of their advantages and shortcomings. This chapter will 


also present a summary of the findings resulting from eye movement 
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research. The third chapter will describe the infrared computer based 
oculometer in detail and will present proof of performance data for 
the system. Chapter four will outline the methodology followed to 
collect and analyze eye movement data using the infrared computer 
based oculometer and will present the findings. Chapter five will 
present a summary of this study together with conclusions and some 


recommendations for further research. 
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CHAPTER II 
REVIEW OF LITERATURE 
Introduction 


Since the visual system is one of man's primary input channels, 
it is important to understand how this system functions. Eye move- 
ment. research or oculography began during the latter half of the 
nineteenth century and since then has been taken up by researchers in 
a variety of different fields with different goals in mind. 

Biomedical engineers have studied eye movements in order to 
better understand the nature of the total oculometor system and the 
relationships that exist between the many complex elements that constitute 
this eee To this end, they have developed computer based simulation 
models of the oculomotor system. Research by biomedical engineers can 
ultimately lead to a better understanding of how information is processed 
in the brain. 

Opthalmologists have studied eye movements primarily from a 
medical standpoint. The development of improved oculographic techniques 
can benefit the opthalmologists greatly in the diagnosis and perhaps in 
the correction of certain eye defects. 

Eye movement research has been a subject of interest to both 
educators and psychologists since Huey published his book on the 
psychology and teaching of reading in 1908 (Tinker, 1965). Since a 
large proportion of education is presented through the visual channel, 
eye movement research can provide information to educators about 


improving the effectiveness of instruction, whether it be by changing 
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the stimulus situation that is presented to the learner, or by modifying 
the looking behavior of the learner. 

This chapter will review the methods that have been developed 
for measuring eye movements and will summarize the findings of eye 
movement studies in terms of the kinds of eye movements that have been 


reported. 


Methods of Oculography 
Yarbus (1968) and Feinstein (1970) discuss the various methods 
of oculography that have been developed, each of which will be identified 


and described briefly here. 


Subjective Method 

Historically, this method of oculography was the first to be 
used. It involves an observer who simply looks at the eyes of a subject 
and manually records his observations of the subject's eye movements. 
This method has been particularly useful in studying eye movements of 
infants (Greenberg and Weizmann, 1971) since no external equipment 
such as head restraints and bite bars is needed. Feinstein (1970) 
points out that "To this day, direct observation of a patient, while he 
attempts to follow an object... . is used as a clinical test to reveal 
any nystagmus or gross disorders associated with the eye movement system." 

Several modifications of this method of oculography have been 
reported wherein the subject, rather than an observer is responsible 
for determining and recording his eye movements. One such modification 
involves the use of "after-images'". Several experimenters including 


Dodge (1907), Helmholtz (1925), Barlow (1952), and others used this 
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method which generally involves having the subject look at a bright wedge 
of light until the retina is fatigued. After the wedge of light is 
extinguished, a clear BreeNitnda: fixed relative to the retina is 

visible to the subject. The subject is required to report the position 

of the after-image he sees while looking at a stimulus target placed within 
his visual field. Since the after-image is fixed relative to the retina, 
any displacement of the perceived position of the after-image relative 

to. the. target. is the direct result.of a change in thepoint of fixation 

by the subject. 

Kaufman and Richards (Richards and Kaufman, 1969, Kaufman and 
Richards, 1969) used the "Haidinger Brush" technique to enable a subject 
to determine and record his own eye fixations. This technique uses 
a slide projector equipped with a blue-light filter and a motorized 
polaroid filter. The subject is instructed to look e a screen on 
which slides SGnealiing the desired stimuli are projected, using this 
specially equipped slide projector. Whenever the researcher wishes to 
have the Ae report his point of fixation, he simply turns on the 
motor which briefly spins the polariod filter. Because the fovea is 
equipped with thousands of blue-light absorbing radially oriented 
crystals whose absorption pattern lies along radii from the center of 
the fovea, linearly polarized light will be absorbed more strongly in 
some parts of the fovea than others. As a result, the subject sees 
a "brush" or wedge of light on the screen, perpendicular to the 
direction of polarization. Because the image thus produced is stable 
with respect to the fovea, it quickly disappears (stabilized image). 
However, when the polarizing filter is spinning, the brush is 


moving relative to the fovea, making it visible to the 
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Ail 
subject, who reports seeing a "spinning propeller" on the screen. The 
point on the screen where the subject reports seeing the spinning pro- 
peller is the point which the subject was fixating when the polaroid 
filter was rotated. 

Feinstein (1970) describes after-image as offering ". . . one 
of the largest dynamic ranges of all methods of oculography.'' However, 
he goes on to point out the shortcomings of all subjective methods of 
oculography stating that ". . . subjective measurements, though very 


useful, give no quantitative record of movement nor can they give 


any temporal information beyond a crude estimation". 


Mechanical Method 

The mechanical method of oculography represents researchers’ 
earliest attempts to quantify measurements of eye movements. Feinstein 
(1970) discussed briefly the work of Delabarre and Huey whose efforts 
at mechanically coupling a recording apparatus to the eyeball he 
described as ". . . a remarkable achievement." 

One extension of the mechanical method of oculography involved 
the use of a contact lens, attached to the eye, and linked either 
optically or magnetically to some recording apparatus. Cornsweet (1956) 
and others used a contact lens with a tiny mirror mounted on it. The 
image of a light source, placed before the eye of a subject wearing the 
lens, was reflected by the mirror to a continuously moving photographic 
film. This gave a permanent quantitative record of eye movements. 
Yarbus (1968) developed a number of "'caps'' designed to be attached to 
the eyeball by using suction, thus avoiding slippage. The caps which re- 


sembled a contact lens reflected a beam of light which traced a record on 
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photosensitive paper. Using "caps'' Yarbus conducted many investigations 
into the nature of eye movements. His findings are probably among the 
most comprehensive and precise available to this day. Robinson (1964) 
used a set of coils imbedded in a contact lens to measure eye movements. 
The coils were exposed to two magnetic fields in quadrature and produced 
output voltages proportional to both horizontal and vertical eye move- 
ments. 

While mechanical methods involving contact lenses or caps are by 
far the most sensitive, it must be pointed out that any mechanical 
method which necessitates the attachment of foreign objects to the eye 
suffers from the disadvantage of introducing additional mass on the 
eyeball. The resulting discomfort for the subject, and altered dynamics 
of the oculomotor system limit the desirability of this method of 


oculography. 


Direct Optical Methods 

Barlow (1952) described a method of oculography that permitted 
a photographic record of eye movements to be made without the use 
of caps or contact lenses. He placed a tiny globule of mercury on the 
anesthesized cornea of the subject's eye and reflected a beam of light 
from the mercury to a continuously moving photographic film. 

A variety of other direct optical methods which did not require 
the introduction of any foreign object or substance into the eye were 
developed. Dodge and Cline (1901) reflected a point source of light 
directly from the cornea and recorded it on a continuously moving 
photographic film. Tinker (1931) and Taylor (1959) describe applications 


of this principle of eye movement recording in devices designed to study 
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eye movements during reading. While many different variations of this 
method of oculography have been developed for studying eye movements, 
perhaps the one that has been most widely used to this time is that 
developed by Mackworth (1967). Mackworth developed a stand camera 
which utilized a beam splitter and which recorded a composite image 
consisting of the target being viewed with the corneal reflection 
superimposed on the target, indicating where, on the target the subject 
was looking. A variety of methods of recording this composite image 
were developed. These included a polariod camera for fast photographic 
processing, a 16 mm. movie camera for capturing temporal information or 
a television camera connected to a video tape recorder. The light source 
used to create the corneal reflection could be fitted with an infrared 
filter, provided that the recording device was also modified to record 
infrared light. This had the desirable effect of minimizing the 
distracting effect of the light source. 

While the Mackworth eye movement camera is likely one of the 
most commonly used oculographic instruments, it offers two major 
disadvantages. First, the analysis of eye movement data recorded in 
this manner is an extremely slow and tedious process. Second, and 
perhaps most important, in order to insure accuracy, the subject's eye 
must remain fixed relative to the camera. This is generally accomplished 
by fitting the subject with a bite bar which he must clench firmly in 


his teeth throughout the recording session. 


Electro-oculography 


A standing potential is known to exist between the cornea and the 


retina of the eye. By attaching electrodes to the left and right of the 
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eye and above and below the eye, the corneo-retinal potential may be 
recorded. Eye movements are recorded as changes in corneo-retinal 
potential and are free from interference due to head movement. Yarbus 
(1968) stated that ". . . electro-oculography is used with fair success 
by many workers when highly accurate records of eye movements are not 
required". Feinstein (1970) points out that the main difficulties 
Peece Taner with electro-oculography are electrode polarization, electrical 


interference or "noise", and data interpretation. 


Electronic Measurement Methods 

Unlike the direct photographic methods of oculography, which rely 
on the direction of reflected light to determine where the eye is looking, 
electronic measurement methods rely on a change in the quantity of light 
picked up by a photocell. While there are a number of variations, the 
technique relies on:the principle that less light is reflected from the 
sclera than from the pupil. When a patch of light is directed onto the 
limbus, (the scleral-pupil boundary), and the quantity of reflected 
light is projected onto a photocell, the photocell output will vary as 
the eye moves and varies the position of the limbus relative to the 
light source. Cornsweet (1956) used this principle in a system which 
scanned light rapidly across the eye and used a photomultiplier to 
monitor the level of reflected light. The length of time taken from the 
start of the scan to a rise in the photomultiplier output was proportional 
to the horizontal eye position. Rashbass (1968) developed a tracking 
system consisting of a cathode ray tube and a photomultiplier tube. A 
spot on the cathode ray tube was projected to the limbus. When the eye 


moved, the spot moved to the cornea and was reflected to a photomultiplier 
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15 
tube. The photomultiplier tube output was used to reposition the spot 
to the limbus. The movement of the spot was therefore proportional to 
the movement of the eye. As was the case with the direct photographic 
methods of oculography discussed earlier, the subject's head had to be 
immobilized, since movements of the head would result in displacement 
of the limbus, thereby giving false readings. 

Young (1962) mounted photocells and lamps in a pair of goggles 
to be worn by the subject, thereby eliminating artifacts that result 
from unrestrained head movement. Feinstein (1970) also used goggles 
similar to Young, however, he utilized infrared light sources, thereby 
eliminating the distraction of visible light. The major advantage of 
electronic methods of oculography is the ability to measure cye 
movements without contact with the eye. While the use of goggles 
limits the amount of head restraint that must be imposed on the subject, 
some head restraint is nonetheless needed if one is to determine 
precisely where, within a target a subject is looking. Freedom of 
head movement would make it possible for the subject to change his 
point of fixation by moving his head rather than his eyes. Such a 
change would go undetected unless an additional monitor was added to 


simultaneously record subject's head position. 


‘The Infrared Computer Based Oculometer 

In 1969, Mason and Merchant described a method of oculography 
which provided relatively unrestrained head movement. The system 
consisted of an image dissector tube which was made collinear with an 


infrared light source and which was positioned adjacent to the target 
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area. The infrared light was absorbed by the skin surrounding the eye 
and by the sclera. Infrared light entered the pupil and was focused on 
the retina, which tended to scatter the light, backlighting the pupil 
to some intermediate level of intensity. In addition, the image of the 
infrared light source was formed as a bright corneal reflection. This 
image of the eye was focused on the photocathode of an image dissector. 
An analog computer was connected to the image dissector. The image of 
the eye was scanned and analyzed by the computer and the output included 
horizontal and vertical eye position, horizontal and vertical coordinates 
of eye pointing direction, and pupil dilation. In 1970, Hillsman, 
Willams and Roe interfaced the image dissector with a digital computer. 
The purpose of this report is to document the development of a 
computer based infrared oculometer which is similar in principle to those 
reported above but which used a Raytheon television camera equipped to 
sense infrared and which wae fully interfaced to a small digital computer 
programmed to determine and record horizontal and vertical eye position, 
horizontal and vertical coordinates of eye pointing direction and pupil 
dilation once every thirtieth of a second. Applications of the computer 


based infrared oculometer to educational problems will also be presented. 


Types of Eye Movements 


Classical eye movement theory identifies three major types of 


classes of eye movements; conjugate or versional movements, vergence and 


tremors. 


Conjugate or Versional Movements 


Conjugate eye movements are movements during which both eyes move 


in the same direction. There are three kinds of conjugate eye movements. 
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17 
Small conjugate movements are involuntary and occur during fixation of 
a stationary target. Feinstein (1970) described small conjugate 
movement as ". . . a slow drift which tends to displace the image of 
the target from the fovea, followed by a small, very rapid flick 
opposite*inedirection= to that) of the drift't".™. tending to relocalize 
the target image on the fovea.'' Mason and Merchant (1969) refer to 
small conjugate eye movements as "eye noise" or "hunting" and describe 
them as consisting of displacements as large as two-tenths of a degree 
away from the point of fixation and recurring at a rate of about five 
times per second. This angular displacement, expressed as a linear 
displacement on a target area twenty inches from the eye of the subject 
would represent a linear displacement of about .07 inches at the target. 
This means that while a subject is fixating on a point twenty inches 
away, the eye will actually be looking somewhere within a circle around 
Ehis* point, Peo stheeely .14 inches in diameter. Yarbus (1968) 
conducted a series of experiments using his "caps" and found that the 
size of small conjugate eye movements is a function of the length of 
fixation and that it’ can vary ". . . between 1 and’ 25 minutes of angle. 
The minimal dimensions . . . between 2 - 5 minutes of angle. The maximal 
dimensions . . . approximately 40 to 50 minutes of angle". Yarbus also 
reported that the duration of small conjugate eye movements depends on 
their amplitude and is approximately 100 to 200 milliseconds with some 
lasting as long as several seconds. Referencing these findings to a 
target area twenty inches from the eye of a subject suggests that small 
conjugate eye movements could lie in a circle around the point of fixation 


slightly larger than one-half inch in diameter. West and Boyce (1968) 
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18 
reported that the rate of drift during a small conjugate eye movement 
was about 5 minutes of angle per second. ‘They found, as did Yarbus that 
the duration of drift varied from approximately 100 mil iseconds to 
several seconds. 

The second type of conjugate eye movement is the saccade, a 
very rapid movement of the eye whose primary purpose is to move the 
eye from one point of fixation to another. Saccades can be either 
voluntary or involuntary. Yarbus (1968) reported that the amplitude of 
a saccade rarely exceeded 15 to 20 degrees of arc. Research indicates 
(Feinstein, 1970) that saccades rarely occur more than once every 200 
‘milliseconds, and that the peak velocity of the eye during a saccade 
can be as high as seven hundred degrees of angle per second. Spache 
(1962) reported that the shortest duration of an effective saccade was 
166 milliseconds and that the minimum time for a saccade to occur was 
a3 milliseconds. Yattbus (1968) found that the total time taken for a 
saccade to occur was’10 to 70 milliseconds, depending on its size. 

The final type of conjugate eye movement is referred to as 
smooth pursuit. Smooth pursuit eye movements occur when the eye tracks 
a smoothly moving target that is moving at a velocity of 35 degrees of 
angle per second or less (Feinstein 1970). Yarbus (1968) conducted 
experiments wherein subjects were required to imagine that they were 
tracking a smoothly moving object. He found that ". .. it always 
appeared to the subject that the movements of his eyes were smooth and 
continuous, in fact they consisted entirely of separate fixations, 
saccades, convergences and divergences." In experiments where the subject 


was required to view a moving object, Yarbus found that the subject could 
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19 
Start or stop visual pursuit of the object at will but could not 
". . . interfere voluntarily with the actual process of pursuit and 
change; its; speed- delibérately.'’ In his analysis of. velocities, of 
pursuit, Yarbus found that with angular pursuit velocities of more 
than five minutes of angle per second, smooth pursuit was possible 
and was characterized by the presence of small conjugate eye movements. 


Satisfactory tracking did not seem possible at speeds exceeding 200 


degrees of angle per second. 


Vergence 

Vergence eye movements are movements during which the eyes move 
in opposite directions. Normally the visual axes of the two eyes 
intersect at some distance from the subject. Divergence refers to 
vergence movements that increase this distance while convergence refers 
to vergence movements that decrease this distance. Feinstein (1970) 
pointed out bist ". . . the amplitude range for vergence movements is 


much smaller than that for versional [conjugate] movements." 


Tremor 

Tremor refers to very small, non-conjugate movements of the 
eyes observed under conditions of fixation (Adler and Fliegleman, 1934). 
Records of tremor have shown it to consist of angular displacements of 
a few seconds of angle at frequencies of 30 to 80 displacements per 
second. Feinstein (1970) states that ". . . it is undecided whether 
they [tremor eye movements] have any physiological significance or 


whether they simply represent noise." 


Of the three classes of eye movements discussed, it would 


appear that the ones most relevant to studies of learning and attention 
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are conjugate eye movements. The fact that both eyes move together 
during conjugate eye movements means that records obtained from one eye 
are sufficient to describe the subject's looking behavior. This study 
will document the feasibility of using the infrared computer based 
oculometer for recording eye movements as they would be used in studies 


ol learning and attention in the field of education. 


Eye Movement Research 


Dodge (1903) was among the first to begin to analyze eye 
movements. His distinction between saccadic and smooth pursuit eye 
movements was investigated further by Westheimer (1954) and Rashbass 
(1960). Rashbass showed that tasks involving various combinations of 
displacement and velocity evoke smooth movement responses determined 
by the task displacement. He concluded that these two different kinds 
of eye movements were the result of two independent neurological 
systems. 

Volkman (1962) compared vision during saccades with vision 
during fixations by means of three psychophysical tasks, in an attempt 
to determine a basis for the lack of apparent blurring during voluntary 
saccades. He concluded that while vision was not blanked out during 
voluntary saccades, it was significantly depressed. Matin, Matin and 
Pearce (1969) sought to further clarify the mechanisms underlying the 
normal stability of visual direction for stationary objects during 
voluntary saccades. They used specific points during the occurrence 
of a saccade as trigger points for the presentation of stationary test 
flashes to subjects. Subjects reported the perceived direction of 


motion of a test flash, relative to a fixation target which was 
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2 
extinguished prior to the presentation of the test flash. Classical 
theory (Helmholtz, 1866; Whitteridge, 1964) suggests that an "extra- 
retinal" signal occurring outside the retina, and proportional to eye 
position, acts to compensate for the shift of the retinal image resulting 
from the movement of the eye, thus a stationary object does not appear 
to change location during a saccade. Matin, et al. concluded from their 
findings that there appeared to be an extraretinal signal, but that the 
extraretinal signal produced was not proportional to eye position. It 
appeared to be proportional to the elapsed time since the beginning of 
the saccade. Pearce and Porter (1970) investigated the possibility that 
i a subject's criterion for visual sensitivity was being depressed during 
voluntary saccades. They developed a criterion-free measure of visual 
sensitivity and using it to measure saccadic supression, demonstrated 
that there was a decrease in visual sensitivity as much as 150 to 200 
milliseconds prior ce the occurrence of a voluntary saccade. 

Krauskopf, Cornsweet and Riggs (1960) analyzed horizontal 
components of eye movements during both monocular and binocular fixation. 
They found that saccades in one eye seemed to always be accompanied by 
saccades in the other eye, almost always in the same direction, and 
about the same size. Drift and tremor of the two eyes are not 
correlated. Huang and Smith (1970) recorded vertical binocular eye 
movements and concluded that movements of the two eyes were not exactly 
conjugate during saccades. They found a time variation of less than 
100 milliseconds. Smith, Schremser and Putz (1971) confirmed these 
findings and concluded that this indicated a possible feedback system 


between the oculomotor control systems of the two eyes. 
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Young and Stark (1963) developed and tested a sampled data 
model to describe the action of the control system of the eye. 
Robinson (1964, 1965) conducted studies of both the saccadic and the 
smooth pursuit eye movement systems. He concluded that while the 
sampled data model of Young and Stark was satisfactory for saccadic 
movements, it seemed to be inadequate for smooth pursuit movements. 

A number of eye movement studies comparing the performance of 
subjects of various ages have been reported. The aim of such studies 
is to investigate the developmental aspect of eye movements. Zinchenko, 
van Chzhi-Tsin and Tarakanov (1963) showed that three year olds tended 
to fixate longer, made little attempt to search for distinctive features 
in a display, and stayed within the area of a figure, compared to six 
year olds. They concluded that eye movements in a growing child 
develop towards locating distinctive features in visual stimuli. 

Vurpillot (1968) studied eye movements of children required to 
judge stimuli as the same or different. She found that children under 
six years old tended to make errors in judgement due to insufficient 
scanning while nine year old children made virtually no errors in 
judgement. 

O'Brien and Boersma (1970) studied the eye movements of 92 
female conservers and non-conservers. They found that conservers 
showed greater perceptual activity in the form of scanning behavior 
than non-conservers. 

Mackworth and Morandi (1967) and Mackworth and Bruner (1970) 
compared eye movements of adults and children on scanning tasks. Adults 


showed a greater facility for fixating areas judged to be more inform- 
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ative. They also tended to have longer "leaping" eye movements and 
shorter fixations. 

Miller (1969) recorded eye movement latencies of eight year 
old children and college students. Subjects were required to change 
their point of fixation from a central fixation light to one of four 
randomly tlluminated target lights displaced equally in each of four 
directions from the central fixation light. He found that eight year 
old children had a longer latency. In addition, he observed that 
differences in latencies among eight year old children were dependent 
on the closeness of the target to the central fixation light. No such 
differences were observed among college students. 

Eye movements have been used as the dependent variable in a 
number of studies of cognitive behavior. Luborsky, Blinder and 
Mackworth (1963) studied eye movements of subjects during a "search" 
task. ‘They found that subjects having more fixations were better 
able to recall the content of perceptual images. Teichener and Price 
(1966) studied eye movements of subjects given the task of studying 
a letter sequence in order to determine the next letter in the sequence. 
They found that a reduction in scanning and an increase in attention 
to detail resulted in correct solution of the task. 

Gould et al. (Gould and Schaffer, 1965; Gould and Brown, 1967; 
Gould, 1967; Gould and Schaffer, 1967; Gould and Dill, 1969; Gould and 
Peeples, 1970) conducted a series of experiments to study eye movements 
of subjects during pattern recognition tasks. They found that subjects 
spent less time looking at incorrect responses than they did looking at 


correct or matching responses. They also reported a quadratic 
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relationship between the amount of information contained in a stimulus 
and the duration of fixation. ‘They concluded that the duration of 
fixation depended on the amount of cognitive activity required for a 
specific task. 

Faw and Nunally (1967, 1968) reported studies of eye movements 
of children viewing pairs of pictures differing on a number of different 
dimensions. They found that subjects spent more time fixating complex 
and novel stimuli. Children spent more time fixating stimuli having 
negative affective value while college students spent more time 
fixating stimuli having positive affective value. Subjects also spent 
more time fixating stimuli constructed by incongruous juxtaposition, 
attempting to resolve informational conflict. 

Conklin, Muir and Boersma (1968) studied eye movements of "tield 
independent" and "field dependent" subjects given the task of searching 
for missing parts within a picture. They found that field independent 
subjects fixated with greater frequency in high-information areas of 
the stimulus field. They concluded that field independent subjects 
employed more effective visual search strategies. Boersma, Muir, 
Wilton and Barham (1969a, 1969b) studied eye movements of field 
independent and field dependent subjects on "imbedded figures" tasks 
and "anagram'' tasks. On the imbedded figures task, field independent 
subjects exhibited more shifts between the target figure and the 
alternatives while on the anagram task, they required less time to 


scan the 5 letters of the anagram. 


Drake (1970) compared eye movements of "impulsive" and "reflective" 


subjects on the Matching Familiar Figures test. Reflectives tended to 
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25 
look at a larger area of the figure before responding than did 
impulsives. 

Muir (1971) studied eye movements of normal and mentally retarded 
subjects during directed search tasks and discrimination learning. His 
results suggested a visual attention deficiency in mentally retarded 
subjects. Yewchuk (1972) studied eye movements of mentally retarded 
subjects during a discrimination shift learning task. lye movement 
data provided no evidence that individual differences in learning 
discrimination tasks could be attributed to an attention deficit. 

liess and Polt (1960) and Hess (1965) studied pupil dilation 
yO subjects presented with a variety of stimuli. They suggest that 
pupil dilation is a measure of interest, emotion, attitude, and on- 
going cognitive process. Clark and Johnson (1970) suggested that 
pupil dilation could be related to cognitive processing. Their results 
agreed with cre vein haaie of Kahneman and Beatty (1966) that the pupil 
dilates as short term memory is loaded and constricts toward normal 
size as material is recalled and short term memory is unloaded. 

Noton and Stark (1971) suggested that eye movement studies of 
subjects looking at a variety of stimuli could provide information about 
whether cognitive processing of visual stimulus information was a 
serial or a parallel (Gestalt) process. They observed that in scanning 
a stimulus field, the subject followed a relatively fixed scanpath around 
a format of features. They discussed the significance of this "feature 
ring" in terms of recognition of stimuli. They concluded that". . 
the weight of the evidence seems to support the serial hypothesis" and 


that ". . . the internal representation or memory of an object is a 
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26 
piecemeal ‘affair. 

A number of studies of eye movements in relation to Learning 
tasks have been reported. McCormack et. al. (McCormack and Ualtrecht, 
1966; Haltrecht and McCormack, 1966; McCormack, Hannah, Bradley and 
Moore, 1967; Hannah and McCormack, 1968; Moore and McCormack, 1968; 
McCormack, Clemence, Tymm and Malabre, 1969; McCormack and Clemence, 
1970) studied eye movement behavior of college students during a variety 
of paried associates learning tasks. These authors have provided a great 
deal of evidence in support of Underwood's (Underwood and Schulz, 1960) 
two stage learning model in which the first stage consists of learning 
the response and is followed by the second stage, which involves 
association of the appropriate pairs. They also found that slow learners 
tend” to take> lonrer during the first ‘Stapé and’ tiey experience more 
difficulty in the second, that eye movements of "high-anxious" subjects 
differ from age dicta ctl of "low anxious" subjects, and that time spent 
scanning the response of a paired associate item decreases as learning 
progresses. 

Guba et al. (1964) studied eye movements of subjects during a 
television lesson. They defined a continuum of eye movements and found 
that "no observable movements" and "minimovements" were related to 
intelligence. They also performed density analyses for areas fixated 
by subjects and found age and intelligence differences. 

Nunally, Stevens and Hall (1965) observed eye movements of 
children after they had learned to associate previously neutral stimuli 
with rewards. Five days after training, subjects spent significantly 


more time looking at stimuli previously associated with rewards. Webb, 
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Matheny and Larson (1963) used shock to condition eye movements of 
subjects. They found that subjects spent significantly less time looking 
at stimuli previously associated with shock. Schroeder (1970) used rein- 
forcement to train eye movements of college students in a simultaneous 
discrimination task. He found that subjects fixated stimuli which had 
previously been reinforced. 

Doran and Holland (1969) studied eye movements of subjects 
studying introductory psychology using programmed instruction. The 
study sought to determine differences in looking behavior of subjects 
studying programmed material with high and low "blackout ratios". The 
blackout ratio was used to provide an index of redundancy. When much 
material could be left out without affecting the error rate, it was said 
to have a high blackout ratio. They found that high blackout ratio 
material resulted in fewer fixations, shorter fixation time and shorter 
Scan time, ienea cite that high blackout ratio programs fail to evoke 
students' attention.- 

Perhaps no single field of study has shown as much interest in 
the study of eye movements as the field of reading. The first descrip- 
tion of eye movements in reading was presented by Javal in 1879. Ile 
reported that the results of direct observation revealed that the 
eyes move along a line in quick jerks, with pauses between the jerks. 
Other attempts to measure and record eye movements of subjects while 
reading were made by Erdmann and Dodge (1898) using a telescope, by 
Miles (1928) using a "peephole", and by Shackwitz (1913) using a 
pneumatic capsule attached to the eyelid. A method pioneered by 


Dodge in 1901 and refined by Tinker in 1931 and Taylor in 1937 based 
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28 
on the corneal reflection principle, led to more than a hundred studies 
involving eye movements during reading. Tinker (1965) presents a 
comprehensive review of eye movement studies in relation to reading. 

A number of more practically oriented studies involving oculography 
have also been reported. Such studies have implications for technical 
and vocational education. Milton and his associates (Milton, Jones and 
Piece. L949. 1950. Mitton. Meintosh and Cole, 1951, 1952, 1954; Milton 
and Wolfe, 1952), Barnes (1970), and Gainer (1964) conducted extensive 
research on eye movements of pilots under a variety of specified flight 
conditions. Their findings were used in the design of airplane and 
helicopter control panels and in the design of pilot training programs. 
Schroeder and Holland (1968) monitored eye movements of subjects 
presented with a vigilance task. Subjects were required to visually 


" 


detect deflection of ammeters arranged in a simulated "control panel" 


configuration. They concluded that " 


an eye movement can act as 
an operant, controlled by its consequences." They suggest that operant 
control of eye movements has important implications for human factor 
analysis concerned with attention. 

One basic underlying assumption of educators involved in 
preparing visual instructional materials for students is that students 
will look at or attend to the appropriate visual material during the 
learning process. If the learner does not attend to the appropriate 
visual material during the learning process, then learning may be 
seriously inhibited. The study of eye movements can provide educators 


with feedback about the effectiveness of their visual material, whether 


it be a page or a picture in a text book, an overhead projectual, a test 
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29 
item or a cathode ray screen of a computer assisted instructional system. 
Such feedback forms one essential part of the basis for producing impro- 
ved visual materials for instruction. It can also form the basis for 
teaching students effective looking behavior. 

It is apparent from the studies reviewed in this chapter that 
oculography has been a subject of interest to many researchers in many 
different disciplines over the past seventy years. The biggest single 
limitation to more extensive oculographic studies has continually been 
the limited sophistication of available hardware. Recent developments 
in electronics and computer technology have now provided some new 
possibilities for hardware that measures records and analyzes eye move- 
ments quickly, easily and unobtrusively. The purpose of this study is 
to document the development of an infrared computer based oculometer 
system designed and built with this end in mind. Chapter III describes 
the infrared tte: based oculometer system and documents its 


performance while the remaining chapters illustrate some applications 


of this system to oculographic research in education. 
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CHAPTER IIL 


DESCRIPTION OF THE INFRARED 


COMPUTER BASED OCULOMETER SYSTEM 
Introduction 


The importance of oculographic data to many fields, including 
education has been recognized for more than half a century. During 
this time, many attempts have been made to develop systems designed to 
acquire eye movement data. Chapter IT briefly describes the basic 
methods of oculography that have been developed. 

Each of the existing methods of oculography was developed to 
meet a specific need. For example, the Yarbus "cap" (Yarbus, 1968) was 
a very precise way to measure and record physiological characteristics 
of the eye, but it would be of little use to a researcher who wished to 
study eye Hay eaeaiee of grade one children while reading. Similarly, the 
Mackworth camera is an excellent means of determining where a subject 
is looking, but the need for a bite bar places the subject in a highly 
artificial experimental situation. 

The study of eye movements in relation to learning and attention 
requires that: 

1. The measuring and recording apparatus be relatively 

unobtrusive. 

2. The equipment require no mechanical attachment to the subject. 

3. The equipment place as few unnatural constraints (such as 

restriction of head movement) on the subject as possible. 

4, As many oculographic characteristics as possible be 
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recorded simultaneously. 

5. The data be in a form that is readily accessible for 

analysis by computer. 

6. The equipment be sensitive enough to detect, and fast 

enough to record all types of conjugate eye movements. 

Since none of the systems currently being used for oculographic 
research meets all of these criteria, it is perhaps not surprising 
that "The number of studies of learning which have employed EM [eye 
movement] data is disappointingly small" (Fleming, 1969). The infrared 
computer based oculometer system described here is an oculographic 
system that will unobtrusively (using infrared light) and with a 
minimum of head restraint (chin rest) record eye-pointing direction and 
pupil dilation, once every thirtieth of a second. 

The infrared computer based oculometer system is based on the 
corneal reflection hethod of oculography. The eye is illuminated with 
infrared light and the image of the eye is projected to the face of an 
infrared television camera which is connected via a special interface 
unit to a small digital computer. The computer rapidly analyzes the 
signal coming from the camera and calculates and records the displace- 
ment of the corneal reflection from the pupil center and the pupil 
dilation. One such set of data is recorded every thirtieth of a 
second. This chapter will describe in detail how the infrared 


computer based oculometer system operates. 


The Eye 


The human eyeball is approximately sperical and contains optical 


apparatus which includes two refracting elements, the cornea which is 
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the transparent, curved front portion of the eyeball wall, and the lens 

which is the refracting element with variable power. The iris, situated 
between the cornea and the lens acts to control the size of the opening 

at the front of the eye. (See Figure 1). 

The sensory apparatus of the eye is the retina, a thin membrane 
of photoreceptors. The area of the retina possessing the highest degree 
of visual accuity is the fovea. (Feinstein, 1970). 

The optical axis of the eye lies along a line joining the center 
of the pupil, the center of corneal curvature, and the fovea. The 
extension of the optical axis foreward from the eye indicates the 


point in space being fixated foveally by the eye. (See Figure 2). 


The Infrared Image 


In order to determine the position of the optical axis of the 
eye, and thereby determine its point of fixation, it is necessary to 
make the pupil Gane and the center of corneal curvature visible. 
This may be accomplished by illuminating the pupil with infrared 
light, which is not visible to the human eye. An observer, equipped 
with an infrared light detector, and situated on an axis collinear 
with the beam of infrared light being used to illuminate the eye would 
see the pupil as a bright luminous disc of infrared light against a 
dark background consisting of the sclera. Within the area of the 
pupil the observer would see a very small spot of light several times 
more intense than the pupil -- the corneal reflection. (See Figure pln 

Neither the center of the pupil nor the center of corneal 
curvature is directly visible as a result of infrared illumination of 


the eye, however both may be easily determined. Since the pupil appears 
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Figure 1 
The Human Eye 
(From Ps G, Kronteld,.1943) 
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Figure 3 


Infrared Image of the Pupil and the Corneal Reflection 
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36 
as a circular disc, the center of the pupil can be located by bisecting 
the perpendicular to a tangent to the pupil. The cornea, because of 
its curvature will form a virtual image of the infrared light source 
as shown in Figure 2. This corneal reflection will lie on a line 
between the infrared source and the center of corneal curvature, 
therefore to an observer located at the source of infrared light, the 
corneal reflection would appear in exactly the same position as the 
center of corneal curvature (see Figure 2). The center of corneal 
curvature can therefore be found by bisecting the perpendicular to a 
tangent to the corneal reflection. 

When the optical axis of the eye is pointed directly at the 
source of infrared light, an observer positioned at the source of 
infrared light would observe the corneal reflection to be at the center 
of the pupil. As the optical axis moves away from the source of infra- 
red light, the corneal reflection will be displaced from the center of 
the pupil. The displacement of the corneal reflection from the center 
of the pupil is functionally related to the displacement of the point 
of fixation from the infrared source. Feinstein (1970) indicates that 
for angular displacements of less than 12 4 degrees of angle, the 
relationship between eye pointing direction and relative corneal 
reflection displacement is linear. Mason and Merchant (1969) state 
that for movements of the subject's head, either sideways or up and 
down, ". . . there is only a small second order effect introduced" 
which may be ignored without appreciable error. It is therefore the 
displacement of the corneal reflection relative to the pupil center 


as viewed from the source of infrared light that will be used as the 
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basis for determining eye pointing direction. 


The Camera 

The complete infrared oculometer camera unit or optical head is 
shown diagramatically in Figure 4. This unit was designed and supplied 
by the Honeywell Radiation Center of Lexington, Mass. and consists of 
a source of infrared light, an infrared television camera and optical 
equipment that reflects the infrared light so that it is collinear with 
the pointing direction of the camera. A Sylvania quartz halogen lamp 
connected to a Superior type 10B variac or autotransformer serves as 
the variable intensity source of light. It is fitted with a lens and 
a Kodak type 87C gelatin filter which removes all visible light with the 
exception of a small amount of red giving it the appearance of a pilot 
light. A beam splitter directs the infrared light towards the eye of 
the subject. The image of the eye is projected through the beam splitter 
and a second infrared filter to the face of a Raytheon model 615 
television camera specially equipped with an infrared sensitive RCA 
4523A silicon vidicon tube. 

The camera converts the infrared image of the eye into a 
standard 525-line interlaced video signal. The size of the video signal 
during any given scan line is determined by the nature of the image 
being scanned. When the black background of the sclera is being scanned, 
the level of the video produced is about 500 millivolts. When the image 
of the pupil is being scanned, the video signal rises to about 1.3 volts 
and when the corneal reflection is being scanned, the video signal 
exceeds 2 volts. Figure 5 shows the video signal produced by the 


camera when the various parts of the image are scanned. 
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In addition to the video signal described above, the camera 
also outputs horizontal and vertical synchronization pulses. A hor- 
izontal synchronization pulse is generated at the end of every scan 
line executed by the camera, therefore there are 15,/50 horizontal 
synchronization pulses generated every second. A vertical synchroni- 
zation pulse is generated whenever the scanning for one field has been 
completed and the camera is ready to start scanning a new field. This 


Occurs sixty times per second. 


The Computer-Camera Interface Unit 


Perhaps the most important element of the entire infrared 
computer based oculometer system is the computer-camera interface 
unit. This unit serves two major functions. First, because it is 
necessary to use the computer to process the camera output, and 
because the size and shape of the camera output signals are not compat- 
ible with the input requirements of the computer, this unit must 
modify the size and shape of the camera output signals to conform to 
the input requirements of the computer. Second, the computer-camera 
interface unit identifies and monitors each scanline generated by the 
camera. Based on changes it detects in the camera output level 
relative to a time base it generates, it determines whether a pupil 
and/or a corneal reflection has been intercepted, the position of 
the point of intercept relative to its time base, and the instant 


when a given scanline has reached the end of its scan. 
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This information is available to the computer to be used as the basis 
for determining oculometer output. 

A simplified block schematic of the computer-camera interface 
unit is shown in Figure 6. This unit consists of two Separate sub- 
assemblies. One sub-assembly contains the crystal clock which is used 
to generate a 10 megahertz time base. The time base is derived from a 
50 megahertz crystal coupled to a "divide by 5" circuit which is reset 
at the start of each horizontal scanline. Im this way, the starting 
point of the 10 megahertz time base can be more precisely aligned with 
the start of the horizontal scanline, thereby improving the accuracy 
with which pupil and corneal reflection intercept points may be 
determined. 

The second sub-assembly contains all of the remaining circuitry 
that makes up this unit. It consists of a plug-in printed circuit 
board equipped with 39 integrated circuits and one transistor. 

When a vertical synchronizing pulse comes from the camera, it 
clears the line count accumulator, indicating that a new field is about 
to be scanned by the camera. When this pulse is terminated by the camera, 
there is a time lag of a few microseconds prior to the occurrence of the 
first horizontal synchronizing pulse. As soon as the first horizontal 
synchronizing pulse is generated by the camera, it increments the line 
count accumulator and puts out an interrupt signal to the computer, 
telling the computer to interrupt whatever it is doing since the interface 
unit must be serviced. The total amount of time required to service the 
interface unit and to prepare the interface unit to monitor the next 


scanline is approximately 18 microseconds. Therefore the horizontal 
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synchronizing pulse is also fed into a variable time delay circuit which 
is adjusted to 18 microseconds, and the output from the time delay 
circuit is used to initiate the operation of the interface unit to 
monitor the next scanline. Since the camera requires only 10.2 mirco- 
seconds to return the scanline to its starting position and begin 
scanning the next scanline and the interface unit requires 18 micro- 
seconds before it begins monitoring the next scanline, the scanline 
performs the first portion of its scan without being monitored by the 
interface unit. This occurs for a period of approximately 14% of the 
total horizontal scan width. Therefore, in positioning the subject 
before the oculometer, care must be taken to insure that the image of 
the eye does not fall within this (the leftmost) region. 

To initiate the operation of the interface unit, the output 
pulse from the time delay circuit simultaneously clears the pupil time 
and CR time accumulators, turns on the pupil time gate and the CR time 
gate, and zeros the divide by 5 circuit on the crystal clock. This 
connects the crystal clock to the pupil time accumulator and the CR 
time accumulator so that these accumulators are incremented by the 
crystal clock by a count of one every tenth of a microsecond. 

If the video signal from the camera is the result of scanning 
black background, the size of the video signal will be smaller than a 
preset threshold voltage level at the comparators. As a result, the 
comparators will not “fire”, and the “flag” will not be raised. When the 
scan is completed, the next horizontal synchronizing pulse occurs, and 


the process is repeated. 


If the video signal from the camera is the result of scanning the 
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pupil, the size of the video signal will be larger than the preset 
reference voltage level at the pupil comparator, but smaller than 
the preset reference voltage level at the CR comparator. This means 
that the instant that the pupil is intercepted the pupil comparator 
will "fire", turning off the pupil time gate and turning on the "flag", 
telling the computer that an increase in video signal has been located. 
At this time, the pupil time accumulator will contain a time measure- 
ment which is directly related to the abscissa, and the line count 
accumulator will contain a scan line number which is directly related 
to the ordinate of the point where the scan line intercepted the 
contour of the pupil. 

If the video signal from the camera is the result of scanning 
the corneal reflection, the size of the video signal will be larger 
than the preset threshold voltage level at the CR comparator. This 
means that the haere that the corneal reflection is intercepted, the 
CR comparator will send a signal which will turn off the CR time gate 
and turn on the flag, telling the computer that an increase in video 
signal has been located. At this time, the CR time accumulator will 
contain the abscissa and the line count accumulator will contain the 
ordinate of that point on the corneal reflection. 

The computer-camera interface therefore senses the contour of 
the semi-circumference of both the pupil and the corneal reflection. 
The abscissa of each point on the contour is recorded in terms of 
"clock pulses" where one clock pulse is one tenth of a microsecond. A 
better indication of the horizontal scale of measure may be attained 


by expressing this as a linear measure at the eye of a subject positioned 
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16 inches from the camera. A horizontal displacement of one clock 
pulse corresponds to a linear measure at the eye of the observer of 
approximately .0064 inches. The ordinate of each point in each array 
is measured in terms of "scan lines". A vertical displacement of one 
scan line corresponds to a linear displacement of approximately .0048 
inches at the eye of the observer. 

Figure 7 illustrates the overall time relationship of the signals 
on this unit relative to the camera output signals. A detailed schematic 


diagram of the computer-camera interface unit is provided in Appendix A. 


The Computer 


The computer portion of the infrared computer based oculometer 
system serves three major functions. First, it monitors the "flag" 
and stores the contents of the three accumulators on the computer- 
camera interface unit whenever the "flag" is raised. Second, when the 
coordinates of fal the points on the contours of the pupil and the 
corneal reflection have been stored, the computer uses this information 
to calculate the displacement of the corneal reflection from the pupil 
center and the pupil dilation. Finally, the computer transfers a 
record of this information onto a 9-track magnetic computer tape. This 
process is repeated once every thirtieth of a second. 

The computer unit will be described in terms of the hardware 
that constitutes this unit, the software or programming that makes 


it operational, and the output that comes directly from this unit. 


The Computer Hardware 


The central process computer used in this research was a rack- 
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47 
mounted model PDP-8/e minicomputer manufactured by Digital Equipment 
Corporation. It was equipped with 8K core, an extended arithmetic 
element, a two channel D/A converter, a one channel A/D converter, a 
power-fail and memory protect option, a 9-track magnetic tape unit and 
a model ASR33 teletype input/output unit. All of the above units were 
standard equipment supplied by Digital Equipment Corporation. In 
addition, a CONRAC video monitor, a Telequipment rack-mount oscilloscope 
and a Sete reference power source were also located on the rack. The 
computer-camera interface unit plugged directly into the bus of the 
computer. 

Appendix B shows the configuration of the equipment on the 
rack. Appendix C shows a simplified block schematic of the computer 


hardware unit used in this study. 


The Software 

All of phe programming for the infrared computer based oculometer 
system was done using machine language. While machine language program- 
ming tends to be the most tedious and time-consuming method of program- 
ming, it was selected for a number of reasons. First, most of the 
programming was completed before the magnetic tape unit arrived. This 
meant that the only way to load system programs such as the assembler 
was via paper tape and the teletype unit. This is an extremely slow 
and tedious process. Second, it was felt that more efficient programs 
could be written by programming in machine language. Finally, since 
the computer was acquiring information from the camera (via the inter- 
face unit) and processing it "on-line", it was more convenient during 


debugging to work in machine language. These factors, combined with the 


ys 


rts ; j 
si ’, ~, 


. ae siyavaon mf \s Uisernetmest ite A rosie aN fants ae he 


5 


hes Stim oqnd citecen sogtsek oe (tae | 
a3 tw asin Te tay) ie teh. aie seasve\auane 
s$ep a ea il fastgsd eo: oaaig renucwon 


Ps morgs 
quaaohhicae snuom-2382 soometape elt # vor knem: conte Tusa) a . oi 
7 fous eis ao Bastbodd ouks Shrnny inp vawndg weinaonatr 1100-2 


ai? 2G 


gud ods nie stout houaeae fur geoph teat sien ) 


wis oo Tasmetupe sie th agldebupi tos dtl ayaa ning 
i fikvothe gob td batiiiqates senile > ” 1% ~~ a 


~asuqwon si to 


yo Janno lost 


bated roduc begws 7? wwf oy soonest ‘he wo a 
“giteorg against enthaseum piso ieneialek epider prea ooh ee ni ? 
sits galmninggesels one ‘eather ioe pais a od: abo gota ® 
tenant ta ies 8 +0 betosiee ew af ull 


“mBIgQo%" 10 
att 29 220m ean 
bat). «bey ree Shee anes obscene aly evo? hsaelqaos enw sateen g07 
soidmades ort 258 
ole Yleoetixe os +t erat eo, ects de bra ayes tonsa aly; 
amswgord 39) sitis ston seta 2183 a) ad. Aeaoee ened nuotiios. 


anise ilaats sanmgmnd sniioem, at gn Lama goty “¢ ‘pod akaw ad vinge 


ans wl), ATOMK esi ens ok seaerg ote gabc lupo. ‘nhor xderue0 ont a 
Ahi ‘ hhc 


“eSINK 
: see “ . 
_gatiub ineimeviion orem anw at ,"aokt—no" 44 gntnasoong bane Ghmu ot 
i ' eh 
edi fiaiv bbitth dere ,esngoa. saedT me entfioam at stow ot ee - hes 
j mM , ha nin - ct 
| | ed 


48 


fact that the overall program was relatively short, led to the decision 
to use machine language in programming the computer. 

Essentially, the program is designed to store the contents of 
the three accumulators located on the computer camera interface unit 
whenever a scan line intercepts either the pupil and/or the corneal 
reflection, and to calculate and store the coordinates of the dispLlace- 
ment of the corneal reflection from the pupil center, and the pupil 
dilation. 

Two conditions are received by the computer from the computer 
camera interface unit; a "flag' that occurs whenever a scan line inter- 
cepts a pupil and/or a corneal reflection, and a "interrupt" that 
occurs whenever a scan line has reached the end of its scan. If during 
the early part of the scanning sequence, neither the pupil nor the 
corneal reflection are struck, the flag is not raised, and as each 
scan line reaches ene end of its scan, an interrupt occurs. The 
absence of a flag means that there is no useful information, which 
needs to be stored, contained in the accumulators on the computer 
camera interface unit, so that immediately after the interrupt has 
occurred, normal program execution resumes as the next scan line 
begins. When a scan line strikes a pupil, the flag is raised. This 
means that the contents of two of the accumulators on the computer 
camera interface unit, namely the line count accumulator and the pupil 
time accumulator, need to be stored. The program therefore modifies 
itself so that immediately after the interrupt has occurred, the contents 
of these two accumulators are stored, and then normal program execution 


resumes, as the next scan line begins. This process is repeated until 
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a corneal reflection is struck. The program then again modifies 
itself so that after the interrupt occurs, all three of the accumulators 
on the computer camera interface unit are stored prior to resuming 
normal program execution. This process continues so that when the 
entire pupil has been scanned, the computer has stored the coordinates 
of every point on the semi-circumference of both the pupil and the 
corneal reflection. 

During the time that the camera is scanning the dark portion 
of the image below the pupil, the computer calculates and stores the 
abscissa of the vertical tangents to the pupil and the corneal 
reflection, the pupil dilation, the diameter of the corneal reflection 
and the vertical displacement between the pupil center and the center 
of the corneal reflection. The dilation is measured and expressed in 
_terms of the number of scan lines that actually intercepted the pupil. 
The ordinate of the pupil center is determined in terms of the absolute 
number of the scan line that pass through the pupil. This is determined 
by simply subtracting the absolute number of the first scan line that 
intercepted the pupil from the absolute number of the last scan line 
that intercepted the pupil and adding half this quantity to the 
absolute number of the first scan line that struck the pupil. (See 
Figure 8). For example, if the first scan line to strike the pupil 
was line 75 and the last scan line to strike the pupil was line 275, 
then the pupil dilation would be (275-75) =200 lines, and the ordinate 
of the pupil center would be located on line (75 + (275-75)/2)=175. 


The ordinate of the center of the corneal reflection is needed to 
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determine the vertical coordinate of fixation, and is calculated in 
exactly the same way as the pupil center. Hence, if the first scan 
line that struck the corneal reflection was line 90, and the last 
one was line 98, then the center of the corneal reflection would 

be located on line (90 + (98-90)/2)=94. The vertical displacement of 
the center of the corneal reflection from the pupil center, which 

is a measure of the ordinate of fixation is simply calculated by 
subtraction, and in the example, is (175-94)=81 lines. Displacements 
occurring when the eye is looking up were labelled positive (+) and 
displacements occurring when the eye is looking down were labelled 
negative (-). 

The abscissa of the pupil center and the horizontal displacement 
of the center of the corneal reflection with respect to the pupil center 
are calculated in terms of 10 megahertz clock pulses. As explained 
earlier in this uiigtee: a 10 megahertz clock begins incrementing the 
pupil time accumulator and the CR time accumulator at the instant 
that the scan line is initiated, and incrementing of each respective 
accumulators ceases when intercept of the pupil and/or the corneal 
reflection occurs. 

To find the abscissa of the pupil center, the abscissa of the 
vertical tangent to the pupil is located first. The radius of the 
pupil is thencalculated based on the measure of pupil dilation obtained 
previously. This abscissa of the pupil center is the sum of the 
abscissa of the vertical tangent to the pupil and the radius of the 
pupil. 


The abscissa of the vertical tangent to the pupil is obtained by 
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calculating the mean horizontal displacement (observed over the four 
scan lines) nearest the center of the pupil. For example, in Figure 

8, the center scan line of the pupil was line 175. The mean horizontal 
displacement of lines 174, 175, 176, and 177 would be used as the 

basis for determining the abscissa of the vertical tangent to the 
pupil. If the observed horizontal time displacements of lines 174-177 
were 296, 297, 297 and 298 respectively, the abscissa of the vertical 
tangent to the pupil would be 297. 

As explained previously, the dilation of the pupil is determined 
in terms of scan lines. Assuming that the pupil is circular, this 
measure of dilation may be expressed in terms of pulses by recognizing 
that the horizontal-to-vertical aspect ratio in a television system 
is 4:3, and that the vertical axis is scanned by 519 lines (consisting 
of 525 lines less 6 lines lost during retrace) and the horizontal axis 
consists of 533 sice The conversion factor for converting length 
measured in scan lines to pulses is (533/525 x 3/4) = 0.77. Therefore, 
the diameter of the pupil may be expressed in terms of pulses by 
multiplying the dilation in scan lines by 0.77. The radius is simply 
half the diameter. In the example in Figure 8, the pupil dilation 
of 200 lines is equivalent to (200 x .77) = 154 pulses so the radius of 
the pupil is 77 pulses. The abscissa of the pupil center is therefore 
(297 + 77) = 374 pulses. 

The abscissa of the corneal reflection is calculated in a similar 
manner except that the mean abscissa to the vertical tangent is calcu- 
lated over 3 lines. In Figure 8, the mean abscissa to the vertical 
tangent of the corneal reflection is 301 pulses, the radius of the 


corneal reflection is ((0.77 x 9) + 2) = 3.46 and therefore the abscissa 
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of the corneal reflection center is 304.46 pulses. 

The horizontal displacement of ae center of the corneal 
reflection from the pupil center, which is a measure of the abscissa 
of fixation is simply calculated by subtraction and in the example 
is (374-304.46) = 69.54 pulses. Displacements occurring when the eye 
is looking to the left were labelled positive (+) and displacements 
occurring when the eye is looking to the right were labelled 
negative (-). 

Upon completion of the calculations as described, the program 
stores the results in core memory. The computer then awaits the 
completion of the scan at which time a new scan is initiated, and 
the procedure is repeated. After each block of 180 sets of readings 
(6 seconds) is accumulated in core, the scanning procedure is inter- 
rupted for two thirtieths of a second while the readings are trans- 
ferred to magnetic computer tape. 

In the event that a complete scan takes place and no pupil 
is found, (as in the case of a blink), or no corneal reflection is 
found (as may occur when the subject looks away from the target at 
some extremely large angle), the program outputs a distinct set of 
characters (7777) in place of the displacement coordinates. This 
makes it possible to detect when "blinks" occurred and to determine 


the duration of the blinks. 


The Output 
Output from the infrared computer based oculometer is stored 


on 9 track magnetic tape. Included in the output are: 
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1. the abscissa of the vertical tangent to the pupil center 

expressed in terms of scan lines, 

2. the abscissa of the vertical tangent to the corneal 

reflection expressed in terms of scan lines, 

3. the ordinate of the displacement between the pupil center 

and the corneal reflection, expressed in terms of 10 
megahertz clock pulses, 

4. the pupil dilation expressed in terms of scan lines, and 

5. the diameter of the corneal reflection, expressed in terms 

of scan lines. 

This provides sufficient data for the calculation of the 
horizontal displacement between the pupil center and the center of 
the corneal reflection. The vertical displacement is available 
directly from the tape. 

In order to express this data in terms of absolute target 
coordinates, it is necessary to calibrate the system to a particular 
subject. This is accomplished by having the subject look at several 
specific points in the target area whose physical locations relative 
to each other are known. By recording horizontal and vertical displace- 
ments of the corneal reflection relative to the pupil center for these 
points, prior to conducting the actual eye movement study, it is 
possible to express the displacements recorded by the oculometer in 
terms of physical location within the target area. The process of 
translating oculometer output coordinates into target coordinates along 


with other data analysis is carried out on the IBM 360 model 67 computer. 
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Proof of Performance 

One problem that is an inherent part of the development of any 
new measuring instrument is the problem of establishing validity, 
reliability and accuracy, or proof of performance of the instrument. 
The infrared computer based oculometer is not unique in this respect. 
This section of the study will describe the method that was followed 
in establishing proof of performance of the system and will present 
proof of performance findings. 

The task of determining where a subject is looking may be 
broken down into several sub-tasks. First, since changes in the 
displacement of the corneal reflection with respect to the center of 
the pupil are related to changes in eye pointing direction, one sub- 
task is to be able to accurately measure this displacement at any 
instant in time. This implies that the infrared computer based 
oculometer system must have the capability of measuring linear distances 
in both the horizontal and the vertical directions. The first part of 
the proof of performance will therefore be to establish the existence 
of this capability. 

A second sub-task is to be able to determine the position of 
the centers of both the pupil and the corneal reflection, since these 
centers are not made directly readable by the illumination process. 
Possible sources of error with respect to the performance of this 
sub-task will be identified and their effect on the determination of 
where a subject is looking will be discussed. 

A third sub-task is to be able to associate an observed displace- 


ment (of the corneal reflection with respect to the center of the pupil) 
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with the actual point in space being observed, taking into account both 
the error due to the oculometer system and error due to uncertainty 
about where the human eye is actually looking at a given instant in 
time. Determination of system performance on this sub-task will result 
in a statement of the system's limits of capability for determining 


where a subject is looking. 


Measurement of Linear Displacement 

In order to assess the capability of the infrared computer 
based oculometer system to measure hortzontal and vertical Linear 
displacements, a simulated eye was constructed. It consisted of a 
black box 3.5'' x 4" x 2" deep. On the face of the box was a white 
circle 0.28 inches in diameter which contained a pinhole arbitrarily 
positioned in the lower right quadrant of the circle. A 5 watt, 110 
volt incandescent lamp was mounted in the box, directly behind the pin- 
hole. When positioned in the field of view of the camera, the image of 
the simulated eye very closely resembled the image of a human eye, the 
incandescent light behind the pinhole created an intense 'spot' 
resembling the corneal reflection, the white circle resembling the 
pupil, and the black background of the box resembling the face of the 
subject. 

For testing purposes, the simulated eye was positioned in the 
field of view of the camera unit so that a properly focused image 
closely resembling the eye appeared on the video monitor. With an 
intensity setting of 40 on the variac, the camera produced a video 


output signal closely resembling that shown in solid lines in Figure /7. 
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The oculometer system was then started, resulting in the simulated 
eye being scanned over 100 consecutive frames, the results of each 
scan being stored in the core memory of the computer. 

All 100 sets of readings taken were identical, demonstrating 
the reliability of the system. It was observed that a total of 58 
scan lines in the horizontal plane struck the simulated pupil, which 
was 0.28 inches in diameter. This demonstrated that the approximate 
vertical resolution rate of the oculometer system is .0048 inches 
between two adjacent scan lines at the eye. Similarly, it was observed 
that the difference in horizontal output corresponding to the radius 
of the simulated pupil (.14 inches) was 22 pulses. This demonstrated 
that the approximate horizontal resolution rate of the system is .0064 
inches between two adjacent pulses at the eye. 

Establishing the validity of the oculometer system in relation 
to measurement of linear displacements was simply demonstrated by 
placing a lens cover over the camera unit. This resulted in output 
from the system signifying that a blink had occurred; that is, that 
the system was unable to locate either a pupil or a corneal reflection. 
No internal noise which could cause a false identification was evidenced 


in the electronics of the system. 


Determining Centers of the Pupil and Corneal Reflection 

Given that the oculometer system is capable of measuring linear 
displacements as indicated above, once the points between which the 
measurement must be made are established, it is necessary to consider 
possible ways in which error might be introduced in the determination 


of these points. Two types of error will be considered. Error 
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designated in this study as "type A" error occurs when a very small 
change in pupil diameter or corneal reflection diameter has occurred, 
while error designated En this study as "type B" error occurs because 
of the system's inability to resolve dimensions less than one scan 

line in the vertical plane and less than one clock pulse in the 
horizontal plane. The effects of each type of error will be considered 
separately for the vertical and for the horizontal directions. 

For measurements in the vertical direction (measured in terms 
of scan lines) it will be assumed that a target positioned in the space 
between two adjacent scan lines will be measured to the nearest scan 
line. That is, if a target extends across lines 20, 21, 22, and beyond 
line 22, partially across the space between lines 22 and 23, it will 
be resolved as extending to line 22 if it extends less than half way 
between lines 22 and 23, and as extending to line 23 if it extends more 
than half way between lines 22 and 23. 

To illustrate the possible effects of type A error on measurement, 
in the vertical direction, the following example will be considered. 
Assuming that a pupil was positioned precisely between and tangent to 
lines 122 and 196. (See Figure 9), simple calculations reveals that 
the center of the pupil would lie on line 159. Now suppose that the 
pupil were to remain stationary at this point, but were to undergo a 
slight dilation. Assuming that the dilation occurred symmetrically 
around line 159, the pupil might at some point in time extend one- 
third of the distance towards lines 121 and 197. This in itself would 
produce no change in the oculometer output. However, if coupled with 


this change in dilation, the subject were to raise his head by one- 
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EFFECT OF "TYPE A" ERROR ON 
MEASUREMENT OF VERTICAL DISPLACEMENT 
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third of a line, the combined effect of dilation and head movement would 
focate the top “of ‘the pupil more than half way toward line 121. The 
oculometer system would then consider the pupil to be positioned between 
lines 121 and 196 with its center lying midway between lines 158 and 
159. Supposing that in the meantime, the corneal reflection had 
remained fixed, the oculometer output would show a change in vertical 
displacement of one-half line even though there was no change in eye 
pointing direction. Since this apparent movement of the pupil center 
could occur either upward or downward, the maximum expected variation 
in the position of the pupil center due to type A error is +5 line. 

The same phenomenon could occur in relation to the center of the 

corneal reflection, hence the maximum expected variation in the position 
of the corneal reflection center would also be + 4s line. However, 
because movement of the pupil center (upward or downward) necessarily 
implies a bap eaenosaite movement of the corneal reflection center, it 
would ony. be expected that these two errors would be cumulative. 
Therefore, the maximum expected type A error for measurement of 
displacements in the vertical plane would be +s scan line. 

The possible effects of type B error on measurements in the 
vertical direction may be illustrated by again considering a pupil 
positioned precisely between and tangent to lines 122 and 196, whose 
centerline would be positioned on line 159 (see Figure 10). If 
there existed a corneal reflection within this pupil such that it was 
positioned precisely between and tangent to lines 169 and 179 with its 
center on line 174, the actual displacement between the two centers 


would be 15 lines, and the oculometer output would indicate this. 
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However, it could also be possible that the entire pupil was positioned 
one-half line higher - just below the point that would cause lines 
121 and 195 to resolve it. The pupil center would then actually be 
midway between lines 158 and 159 although the oculometer system would 
locate it on line 159. At the same instant the. corneal reflection 
could be positioned on-half line lower - just above the point that 
would cause lines 170 and 180 to resolve it. The corneal reflection 
center would then actually be midway between lines 174 and 175, although 
the oculometer system would locate it on line 174. In this case, 
therefore, the actual displacement between the two centers would be 
16 scan lines, but would be recorded by the oculometer system as 15 
scan lines. In a similar manner, the pupil could be located as much 
as one-half line below lines 122 and 196 while the corneal reflection 
could be located as much as one-half line above lines 169 and 179. In 
this case, the oculometer system would still record the displacement 
between the two centers as 15 scan lines even though the actual displace- 
ment was only 14 scan lines. Therefore the maximum expected type B 
error for measurement of displacements in the vertical plane would be 
tlescant line. 

For measurements in the horizontal plane, (measured in terms of 
10 megahertz clock pulses) it will be assumed that a target positioned 
in space between two adjacent clock pulses will be measured in terms 
of the last complete clock pulse that intercepted the target. That is, 
if a target begins part way between pulse 22 and pulse 23, then it 
will be recorded as beginning at pulse 22, regardless of how near it 


exists to pulse 23. 
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To illustrate the possible effects of type A error or measure- 
ments in the horizontal plane, the following example will be considered. 
Supposing a pupil were el eaa so, that. each of the four horizontal 
scan lines intercepted the vertical tangent to the pupil just as pulse 
150 occurred (see Figure 11). Now, supposing that the pupil were to 
remain stationary at this point, but were to undergo a slight dilation. 
If the dilation was less than half a scan line the dilation reading 
recorded by the oculometer would remain unchanged. However, this 
slight dilation could be sufficient to cause the mean abscissa of the 
vertical tangent to the pupil to appear at pulse 149. As a result, an 
observed change in horizontal displacement equal to one pulse would be 
recorded by the oculometer when no actual change in eye pointing 
direction occurred (see Figure 11). Because only the leading edge 
(left edge) of the pupil circumference is sensed, type A error could 
only operate in a manner so as to decrease the true value of the 
horizontal position of the pupil center by one. A similar change could 
occur in the corneal reflection, resulting in a type A error in the 
position of the center of the corneal reflection, operating, as in the 
case of the pupil, to decrease the true value of the horizontal position 
of the center of the corneal reflection by one. The occurrence of both 
of these events simultaneously (since they both operate in the same 
direction) would result in cancellation of the error, therefore the 
maximum expected type A error for measurement of displacements in the 
horizontal plane would be -1 pulse. 

The possible effects of type B error on measurements in the 


horizontal plane are illustrated in the example of Figure 12. Supposing 
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a pupil were positioned so that each of the four horizontal scan lines 
intercepted the vertical tangent to the pupil just as pulse 150 occur- 
red. Now supposing that the pupil were to move to a new position 

to the right (as shown by the broken lines of Figure 12) by an amount 
just less than one pulse. Because the movement would not be sufficient 
to change the observed position of the vertical tangent to the pupil 
the position of the pupil center would appear unchanged, even though 

a change of nearly one full pulse had occurred. Therefore the maximum 
expected variation in the position of the center of the pupil is -l. 
pulse. The possible effects of type B error on the determination of 
the horizontal position of the center of the corneal reflection are 
identical to those just described for the pupil, therefore, the maxi- 
mum expected variation in the position of the center of the corneal 
reflection is also -l pulse. The occurrence of both of these events 
simultaneously would result in cancellation of the error, therefore 
the maximum expected type B error for measurement of displacement in 


the horizontal plane is -1 pulse. 


Actual System Performance 

In order to assess the actual overall performance of the infrared 
computer based oculometer system, given the maximum expected errors of 
measurement for the system sub-tasks, a series of experiments involving 
both the simulated eye described earlier in this chapter and a human 
eye were carried out. The purpose of the experiments involving the 
simulated eye was to gather additional data to demonstrate the 


reliability and the validity of the oculometer system in a task 
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67 
involving the determination of the positions of the pupil center, 
corneal reflection center and pupil dilation,wand the cabkculation/s of 
the horizontal and vertical displacements between the pupil center 
and the center of ae corneal reflection for a stationary target. 
Because the normal human eye does not stay perfectly fixed, even when 
[t is fixating on a stationary target oculometer output obtained from 
a human eye fixating a stationary target would include error resulting 
from normal movements of the eye inseparably combined with type A 
and type B errors. Therefore a statistical approach, presenting 
frequency distributions of oculometer system output for various tasks 
_ involving the human eye will be used to describe overall system 
performance. 

In the second series of experiments, a simulated eye was 
positioned in the field of view of the camera unit of the oculometer. 
The video monitor-was observed while the camera unit was adjusted to 
insure that it was properly focused. The intensity of the infrared 
light source was adjusted so that the video output voltage was as 
specified in Figure 8 (variac setting of approximately 50). The 
computer program included in appendix D was used but was modified to 
stop after 100 consecutive scans were completed. The output consisted 
of the coordinates of displacement between the pupil center and the 
center of the corneal reflection as well as pupil dilation. The 
observed measures of dilation and of displacement were 70 scan 
lines and 24.5 scan lines respectively. The variance of each of these 


was 0. The observed measures of X - displacement were normally 
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distributed around a mean of 7.69 pulses with a variance of 0.21. The 
experiment was repeated two more times, once with the "corneal reflec- 
tion" pinhole blocked off so that no corneal reflection voltage was 
present, and a second time with the entire pupil covered by a piece of 
black construction paper. In both cases, the oculometer system output 
consisted of 100 identical readings, each denoting that a "blink" had 
been detected. 

These experiments appear to strongly support both the validity 
and the reliability of the oculometer system. In the first case, 
identical readings obtained for measures of dilation and Y-displacement 
strongly suggests that the system provides a reliable measure for these 
parameters. The observed distribution of measures of X-displacement 
indicate the relatively high reliability with which the system measures 
this parameter. In the latter two cases, by eliminating portions of 
the simulated eye, me was demonstrated that the oculometer output 
changed appropriately, which suggests that the output from the 
oculometer system is a valid measure of displacement between the pupil 
center and the center of the corneal reflection. 

In the third series of experiments, an IBM 1500 video terminal 
was positioned adjacent to the oculometer as shown in Figure 2 es 
Biometrics model 115 head restraint was positioned in front of the 
video terminal, so that the eye of a subject whose head was positioned 
in the chinrest of the head restraint would be 16 inches away from the 
screen of the video terminal. With a subject positioned in the head 
restraint, the video monitor was observed while the camera unit was 


adjusted to insure that it was properly focused. The intensity of the 
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infrared light source was adjusted so that the video output voltage 
was as specified in Figure 8 (variac setting of 45 to 50 depending on 
the subject. In various experiments that followed, a target consisting 
of an asterisk (*) was displayed in a variety of known coordinate 
locations on the video terminal. Because the movements of the eye 
are more steady when it is pursuing a smoothly moving object (Yarbus, 
1967) the IBM 1500 CAI system was programmed to display a "moving 
asterisk". For experiments involving vertical displacements, the 
asterisk was programmed to move back and forth in a pendular fashion 
horizontally across five columns in specific rows, pausing for 300 
milliseconds in each column. For experiments involving horizontal 
displacements, the asterisk was programmed to move up and down in a 
similar fashion, across five rows in specific columns, pausing for 
300 milliseconds in each row. The subject was instructed to look at 
the asterisk. For a trial, 100 consecutive oculometer readings 
were taken. Table 1 is a summary of the displacements observed for 
one subject under different display conditions. 

The mean vertical output displacement between the corneal 
reflection center and the pupil center was 20.15 scan lines while 
the subject was looking at the top row of the display and 5.44 scan 
lines while the subject was looking at the bottom row of the display. 
This represents a change of 14.71 scan lines resulting from a change 
in fixation of 4.6 inches, the distance between the top and bottom rows 
of the display. This means that a change in the point of fixation of 
.16 inches would result in a change in the vertical displacement output 


of 0.5 scan line. That is, neglecting error, the oculometer would be 
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TABLE 1 
Oculometer Output for 


Various Target Locations 


Mean 


Location of Asterisk : 
Oculometer Output Displacement 


Horizontal Vertical Horizontal Vertical 
Coordinates Coordinates Pulses - Variance pune - Variance 
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capable of detecting vertical changes in eye fixation greater than 
0.16 inches on a display positioned 16 inches from the eye of the 
subject. This corresponds to an angular displacement of 0.6 degrees. 

It has already been pointed out that for measurements in the 
vertical plane, the maximum expected type A error was +% scan line 
and the maximum expected type B error was +1 scan line. Table 1 
shows that the greatest variance of the observed vertical output 
displacements for the subject tested was .13. This corresponds 
to a standard deviation of less than 0.4. Because of the possibility 
of +45 scan line of error associated with any given reading, and 
because % scan line has been found to correspond to .16 inches at a 
display 16 inches away from the eye, a given vertical displacement 
output coordinate defines a region .32 inches high which contains the 
point on the screen being fixated. Fixations within a region of - 32 
inches or 1.2 We hcs Aare not be distinguished from each other. In 
order to distinguish between two points fixated on a display 16 inches 
from the eye, using the AG 8S een oculometer output, the 
two points must be separated vertically by more than .32 inches (1.2 
degrees). 

The mean horizontal output displacement between the corneal 
reflection center and the pupil Santor was 14.52 Mace while the 
subject was looking at the right edge of the display and -7.32 pulses 
while the subject was looking at the left edge of the display. This 
. represents a change in horizontal displacement output ofe2164 pulses... 


resulting from a change in fixation of 7.9 inches, the distance between 


the left and right edges of the display. This means that a change ih 
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in the point of fixation of 0.18 inches would result in a change of 

0.5 pulse in the oculometer horizontal displacement output. That is, 
neglecting error, the oculometer system would be capable of detecting 
horizontal changes in eye fixation greater than .18 inches on a display 
16 inches away from the eye. This corresponds to an angular displace- 
ment of about 0.65 degrees. 

As in the measurement of vertical displacement discussed 
earlier, because of this error, it is only possible to define a region 
which is 0.36 inches wide which contains a point on the display being 
fixated. Fixations within a region 0,36 inches wide or 1.30 degrees 
may not be distinguished from each other. In order to distinguish 
between two points fixated on a display 16 inches from the eye of a 
subject, using the horizontal displacement oculometer output, the 
two points must be separated by more than 0.36 inches (1.30 degrees). 

In order to assess the linearity of the infrared computer 
based oculometer system, the numbers one to nine and the letters A 
and B were sequentially displayed at known coordinate locations of 
the screen of an IBM 1500 video terminal (see Figure 13). Each 
character appeared on the screen for exactly six seconds. The subject 
was positioned in front of the screen as previously described and was 
instructed to fixate each character as it appeared. Figure 13 shows 
the positions of the digits on the screen. Of the 180 readings 
obtained for each point fixated, the first thirty were rejected to 
insure that the eye had completed its saccade from the previous 
point being fixated. The next 60 readings were kept for analysis. 


The last 90 readings were not used since there is some evidence in 
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74 
the literature that as the length of time spent fixating an object 
increases, the size of the drifts away from the point of fixation 
will also increase. 

In order to calibrate the system, the mean observed X - 
coordinate for points six and A of the display was taken to be 
the X-distance between point six and A - two points which were three 
inches apart was used to establish a measure of the vertical resolution. 
Similarly the mean observed Y-coordinates for points seven and eight 
of the display was taken to be the Y-displacement for fixations on 
rows 18 and 19 of the screen and the distance between points seven 
and 8 - two points which were exactly four inches apart was used to 
establish a measure of the horizontal resolution. Table 2 shows a 
summary of calibration data obtained in this manner. 

Based on the calibration data of Table 2 and the known 
locations of the Galibyamion points on the screen, expected coordinate 
values for each of the eleven calibration points were calculated and 
compared to the observed coordinate values. Table 3 shows the 
comparison of expected and observed coordinates for the calibration 
points. 

As indicated in Table 2, the vertical resolution of the system 
was 3.14 scan lines per inch at the screen of the video display. Since 
each character displayed on the screen was 0.3 inches high, this repre- 
sents 0.94 scanlines. Similarly since the horizontal resolution was 
2.46 pulses per inch, and each character displayed was 0.2 inches wide, 
this represents 0.49 pulses per character. Relating this to the error 


scores in table 3, one Y-displdcement (the character B) and nine 
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TABLE 2 


X and Y Calibration Data 


Mean Mean 
Observed Observed 
Stimulus Column Row X-Displacement Y-Displacement 
6 19 8 and 9 334 ihayeee # | 
A 19 28 and 29 4.66 6.38 
Mean A oe 4.00 
Vertical Resolution or 
Scan Lines per Inch 3.14 
y) 9 LS and 19 SeZ2D OG 
8 ei 29 18 and 19 -1.59 10.90 
Mean 10.82 
Horizontal Resolution 


Pulses per Inch 2.46 


X-Displacement measured in terms of pulses 


Y-Displacement measured in terms of scanlines 
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X-displacement readings (the characters 3-9, A and B) had error scores 
greater than the size of a character. Only three characters (4, 5 and 
9) had an X-error greater than two characters. 

Since the angular displacement of the top row and the left edge 
both exceed 12 4 degrees, and since earlier studjes have suggested that 
the corneal reflection method is only linear for displacements of less 
than 12 5 degrees, these errors can probably be attributed to non- 
linearity. However, since the remainder of the observed errors are 
small in relation to the size of the target being fixated, they will 


be considered negligible for the purposes of this study. 


Summary 


This chapter describes the infrared computer based oculometer 
system developed for recording eye movements of subjects involved in 
various learning tasks. It also provides details on proof of 
performance of the system. ‘The following chapter will deal with the 
application of the infrared oculometer system. It will describe the 
conditions under which eye movements of subjects were recorded during 


some learning tasks and will present the findings. 
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CHAPTER IV 


DESCRIPTION OF TESTING AND 


PRESENTATION OF FINDINGS 
Introduction 


Knowing where a subject is looking under given stimulus 
conditions is important to many different fields of research. In 
education, it is particularly important, because failure of stimuli 
to elicit a visual response from the learner can often inhibit 
learning. Knowing how the learner responds to a visual stimulus can 
Pont de the instructor with feedback, making it possible for him to 
modify stimulus material in order to elicit the desired visual response 
from the learner. 

This study describes and documents the development of an infra- 
red computer aeA oculometer which would provide a means for deter- 
mining where subjects are looking when presented with visual stimuli. 
This chapter describes how three subjects' eye movements were recorded 
while they were viewing visual stimuli presented to them in a simulated 
learning situation. It also presents the analysis of these eye move- 


ments. 


Procedure 
The stimulus materials used in this study were presented 
to subjects via a video computer terminal connected to the IBM 1500 
computer assisted instruction system in the Division of Educational 


Research Services of the University of Alberta. A total of five 
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stimulus situations were presented to each of three subjects. The 
first stimulus situation consisted of the numbers one to nine and 

the letters A and B as described in chapter three and illustrated in 
Figure 13. The purpose of this stimulus situation was to obtain data 
for each subject that would permit calibration of the system to the 
subject. 

The second, third and fourth stimulus situations are shown in 
Figures 14, 15 and 16 respectively. ‘These stimulus situations were 
frames of material selected from a course in inferential statistics 
developed for use with the IBM 1500 CAI system. One word was 
deliberately spelled incorrectly in stimulus situation 1 and was 
intended to provide a calibration check at the end of the testing 
sequence. 

The subjects were all mature adults (two male and one female) 
and all were familiar with elementary statistical terms and concepts 
and all were familiar with the video terminal. Each subject was 
positioned in an adjustable chair at a desk on which was located the 
IBM 1500 video terminal and adjacent to it, the Honeywell optical 
head. The general testing procedure was explained to the subject, 
then the subject's head was positioned in the headrest and the chair 
and headrest were adjusted until a clear, well focused image of the 
pupil and corneal reflection were visible on the video monitor. The 
subject was asked to look at various locations on the display while 
the intensity of the infrared source was adjusted. Finally, the 


computer was started and the presentation of visual stimuli was 
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initiated by the researcher. Stimulus situation 1 presented the subject 
with the numbers one to nine and letters A and B sequentially, each 
character being displayed for six seconds. At the end of stimulus 
situation 1, stimulus situation 2 was automatically presented and was 
kept on the screen for 20 seconds. This was sufficient time for all 
subjects to finish reading this frame, which, as may be seen from 
figure 14, consisted of eight lines of text. After 20 seconds, stimulus 
situation 3 was automatically presented. This stimulus situation 
consisted of some text combined with a figure depicting a histogram 
as shown in Figure 15. The subject was required to press the space 
bar in order to go on to the next stimulus situation. Stimulus situa- 
tion four consisted of some text and a graph. The text asked a 
question, such that the subject would have to view the graph, then 
view three possible answers to the question. The subject was instructed 
to simply think of the right answer - he was not required to give a 
response other than a visual response. After 20 seconds, the last 
stimulus situation, which consisted of the calibration stimuli used in 
stimulus 1 was automatically presented. 

At the end of the testing sequence, the magnetic tape containing 
the data was removed and delivered to the IBM 360 system for analysis. 
A number of programs were written in Fortran to analyze the data 
contained on the tape. While in this study, a separate tape was made 
up containing data for each subject, this, in general would not be 
necessary since the oculometer system is capable of registering an 


"end-of-file" mark on the tape. This would insure that each subjects’ 
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data would be kept separate. 


Analysis 


Stimulus Situation 1 - Calibration 

The analysis of the data consisted of calculating the X- 
displacement for each set of readings recorded, summarizing the 
data, scaling the data to linear dimensions corresponding to the 
Size of the display screen and plotting the data, superimposed on the 
appropriate text. Each analysis of eye movements will be presented 
separately for each subject. 

Table 4 presents a summary of the calibration data obtained for 
each of the three subjects when they were viewing stimulus situation 1 
(see Figure 13). To calibrate the system to each individual, a set of 
imaginary axis running vertically between points six and A and 
horizontally between pasate 7 and 8 were established. These points 
were selected because they were approximately in the center of the 
display screen. In this manner, the angular displacement of the eye 
while fixating these points would likely be small enough so as not to 
introduce error due to non-linearity (12 % degrees). 

The position of the mean X-calibration axis, the imaginary 
vertical line between points 6 and A was determined by calculating the 
average of the mean observed X-displacements recorded for a period of 
two seconds (60 readings) for points 6 and A. For example, the mean 
X-calibration axis for subject one (table 4) was 0.99. This means that 
the estimate of the X-displacement between the pupil center and the 


corneal reflection for subject 1, when he was fixating points on a 
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vertical axis joining points 6 and A was +0.99. Similarly, the position 
of the mean Y-calibration axis, the imaginary horizontal line between 
points 7/7 and 8 was determined by calculating the average of the mean 
observed Y-displacements recorded for a period of two seconds (60 
readings) for points 7 and 8. For example, the mean Y-calibration axis 
for subject 1 (Table 4) was 10.09. This means that the estimate of 
the Y-displacement between the pupil center and the corneal reflection 
for subject 1, when he was fixating points on a horizontal axis joining 
points 7 and 8 was 10.09. 

The horizontal resolution for each subject was estimated by 
dividing the difference between the mean observed X-displacement for 
points 7 and 8 by the physical distance between these points on the 
display screen (4 inches), and was expressed in pulses per inch. For 
example, the mean observed X-displacement for subject one (Table 4) 
while fixating point 7 was 5.77 pulses while the mean observed X- 
displacement for this subject while fixating point 8 was -3.98 pulses. 
The change in X-displacement as the subject changed his point of 
fixation from point 7 to point 8 was (5.77 - (-3.980) = 9.75 pulses. 
Since these points were four inches apart on the display screen, the 
horizontal resolution for subject one was (9.75 + 4) = 2.44 pulses 
per inch. This meant that assuming a linear relationship between the 
displacement of the corneal reflection from the pupil center and the 
corresponding change in the horizontal position of the point being 
fixated, for every inch that the point of fixation moved on the display 
screen, the observed X-coordinate of the displacement of the corneal 


reflection from the pupil center changed by 2.44 pulses. 
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The vertical resolution for each subject was estimated similarly 
except that the mean observed vertical displacements for points 6 and 
A (located three inches apart on the display screen) were used to 
estimate it. Also since vertical displacement was measured in terms 
of scan lines, the vertical resolution was expressed in terms of scan 
lines per inch. 

Civen the X- and ¥—'calibration data for a subject, it is 
possible to calculate the expected values of X- and Y- displacement 
between the corneal reflection and the pupil center for any point on 
the display screen. For example, supposing subject one were fixating 
a point that was one inch above the horizontal calibration axis (points 
7, and 8) and one inch... to the left.of thei:vertical. calibration axis 
(points 6 and A). Since his horizontal resolution rate was 2.44 pulses 
per inch, the expected X-displacement between the corneal reflection 
and the pupil center would be 2.44 pulses greater than it was when the 
subject was fixating the vertical axis or (0.99 + 2.44) = 3.43 pulses. 
Similarly, since his vertical resolution rate was 3.68 lines per inch, 
the expected Y-displacement between the corneal reflection and the 
pupil center would be 3.68 lines greater than it was when the subject 
was fixating the horizontal axis or (10.09 + 3.68) = 13.77 lines. 
Conversely, given a set of X- and Y- displacement coordinates and the 
calibration data, one can estimate the point on the display screen (with 
reference to the horizontal and vertical calibration axes) that the 
subject was fixating. 

In order to assess the possible error that was inherent in 


this method of estimating eye pointing direction, expected X- and Y- 
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88 
coordinates were calculated for each of the calibration points. 
Observed mean displacement coordinates were subtracted from expected 
coordinates: In order to estimate the error. Tables 5 - 7 show the 
error scores and Figures 17 ~ 19 show the plots of the calibration 
points as they appeared on the display screen together with the plots 
of calculated eye pointing: position for each of subjects 1, 2 and 3 
respectively. 

Subject 1 had a total of 5 calibration points that were more 
than one character width away from the calculated position in the 
horizontal plane and two points that were more than one character height 
away from the calculated position in the vertical plane. Subjects two 
and three had three and seven (respectively) calibration points that 
were more than one character width away from the calculated position 
in the horizontal plane and two points that were more than one 
character height away from the calculated position in the vertical 
plane. Subject two and three had three and seven (respectively) 
calibration points that were more than one character width away from 
the calculated position in the horizontal plane and one and no points 
more than one character height away from the calculated position in the 
vertical plane. Figures 17 - 19 show the uncorrected plots of the 


observed eye pointing position relative to the position of the calib- 


ration points for each subject. 


Conclusions 
In view of the fact that previous studies have reported that 
the corneal reflection method of calculating eye pointing coordinates 


was not linear beyond 12 ¥% degrees of displacement, and in view of the 
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TABLE 5 


Error Table for Subject 1 


Expected Observed X Expected Observed x 

Calib. Point X-Disp. X-Disp. EEror Y-Disp. Y-Disp. Error 
iy 10.26 8.68 hes 20.02 19.03 799 
2 yoy: 4.06 ew 20202 jE SSS uE Fa fa 
3 Spee) 0.44 oa0 20202 LOR oo. eva 
4 Seo ara ee 20.02 19.42 60 

2 =Oul -8.83 04 20502 18.69 agi 
6 O99 (Sul 250 AES ail E5350 FALE 
7 5.87 Bvralill alt 103.09 10.06 nS 
8 -3.89 -3.98 20g 10.09 LOR -03 
9 10.26 LOS3Z . 06 4.57 3.96 62 
A 0.99 eS Ae 8) 4.57 4.47 - LG, 

B —-8./77 -7.01 Caer 4.57 2.64 198" 


* 
Denotes errors greater than one character in size. 


hy ‘ Lhe 7 y 
Haky 
" te tISe 


au. 
x tastiaut oxat Mah or a aes gui: BY, 
ot ; A 7 oe wa ; A shat si v A j 
ise tia PaNi ie 
7 2+ rr st See eee TT Seer Sees verte mune 


t i> ay Se at J f , se a a A Neel 
Py eas ee yas’ yalrd-¥ 


ve. py .e) 0, Ok ae ee ast +i 
UE te pV eth, (y.4 Page" 
R., ia,2 ee ee Se 
ao) | ee ee ee ee 
"Es 6. 84° SDS w),. EBB 


iP. a | fae eee © ae eg 


co. at 4 a a Re; a 


a8 oan ae eo.or on is et ‘i: : oye eo | 
Ae, dee cee jal pas gee Soe | 
; ' “4, ie err a i ine W i 
ae Vo Se a. Whe ep” €e.8 ie: 
Mud y de ay at fm 2 5 fae 
oP 1 apy st Res wat RO {\,.8- 


a ee nie mien ee eee vat meee weil sh ian ih 
i 4 7 . - ty it si 
4 uN i : a na 
gace it oo bpaaglo O00 MhHY SiReity atet3s 


Soot Ack ba a 


Sy 


ac 


in ; i rhe ) ns 


“Ty 


Cat tb’. 


B 


90 


TABLE 6 


Error Table for Subject 2 


Expected Observed X Expected Observed Y 
Point X-Disp. X-Disp. Error Y—Disp’. Y-Disp. Error 
203 20.04 ear 22.68 DAN M/k 597 
LOD 14.18 eo DLOS PM A 2 296 
10.01 8.61 1 aGr 227,08 DIAS) 230 
od) 4.81 44 22.68 22-6 34 -34 
Ene, 2,15 ar 22.68 21.47 oe 
10.01 9.76 a25 Ly. 99 18.10 el, 
15.65 15.69 0a. aig 12412 01 
4.37 4.40 8) Lets Le h3 .00 
20273 PAs Wey) 0 6.26 SOFT ~49 
10302 10226 425 6.26 6:87 fil 
—1,.27 -1.49 Ze 6.26 6.02 24 
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* 
Denotes errors greater than one character in size. 
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Error Table for Subject 3 
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TABLE 
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Expected Observed X 
Calib. Point X-Disp. X-Disp. Error 
* 
L oleae 62/3 1.48 
2 a7 305 Ba 
5 O53 -1.58 2/05 
4 Kao oy -4.93 E42 
* 
5 Bhs es. -9.24 169 
6 Ons 46 0.07 
7 Hy GY) wk 
8 = 3/5 DL =3), 92 Sah 
2) aaah w* 
A 0.83 LOL 48 
* 
B -7.55 -8.76 Loe 
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761 
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Observed 
Y-Disp. 
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18.70 
S295 
18.93 
17.84 
14.52 
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Denotes errors greater than one character in size. 


KK 
Denotes missing data. 
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Uncorrected Eye Pointing 
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Positions for Subject 2 
Viewing Stimulus Situation 1 
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fact that some regions within the video display area required angular 
displacements greater than 12 degrees when being fixated, a procedure 
was developed for correcting observed eye pointing coordinates recorded 
when subjects fixated video display regions beyond 12 } degrees. 

To determine which observed vertical displacements required 
correction, the vertical displacement ordinate that corresponded to 
12 45 degrees of displacement was calculated. Because the horizontal 
distance between the subject's eye and the display screen was constant 
at 16 inches, a vertical displacement of 12 's degrees was found to be 
(16 tan 12 4) approximately 3\% inches. Since the vertical resolution 
for each subject was previously estimated, it was possible to calculate 
a critical value of vertical displacement between the corneal reflection 
and the pupil center, and that observed vertical displacements greater 
than this amount would require correction due to non-linearity. For 
example, the vertical resolution for subject 1 was 3.67 scan lines 
per inch, therefore the critical value of vertical displacement 
(3 4 inches) was 3.5 x 3.68) = 12.85 scan lines. 

In order to determine the vertical correction factor, it was 
assumed that the amount of correction necessary would be a linear 
function of the amount of vertical displacement greater than the critical 
value. The amount of non-linearity correction per scan line above the 
critical line was therefore computed by dividing the difference between 
the mean expected Y-displacement and the mean observed Y-displacement 
for calibration points one to five by the number of scan lines between 
the critical scan line and the mean observed Y-displacement for 


calibration points one to five. For example, the mean expected Y- 
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displacement for subject 1 was (A904. +. 19030. 10.3) + 0.40 4 
18.70) + 5) = 19.15. Therefore the vertical correction factor for 
Subject one was ((20.0 - 19.15) + (19.15 - 2 2Ga)) =O. 22 sean 
lines pees line above the critical Y-displacement. 

A similar procedure was implemented for determining which 
observed horizontal displacements required correction; except that 
for this case, since eye movements both to the left and to the right 
of the infrared light source were possible, critical values of 
horizontal displacement for displacements to the left and to the 
right of the infrared light source had to be calculated. For example, 
based on a horizontal resolution of 2.44 pulses per inch for subject 
one, the critical values of horizontal displacement for subject one 
(3.5 inches) were (3.5 x 2.44) = + 8.54 pulses. The mean observed 
horizontal displacement between the pupil center and the center of the 
corneal ore wey the right edge of the screen was determined by 
calculating the mean observed X-displacement for calibration points 
fiveandieight.«. This, was) found,to,be..(G1s =:8,.83, +.> 7.01) + 2) = 7.92 
for subject one. Since this was less than the critical value of 
horizontal displacement, no correction was necessary for subject one 
on observed horizontal displacements to the right. The mean observed 
X — displacement for calibration points one and nine was ((8.868 + 10.32) 
+ 2) = 9.50. Since this was greater than the critical value, corrections 
to observed X - displacement data to the left of the screen were calcu- 
lated by determining a horizontal correction factor in a manner similar 
to that already described for calculating a vertical correction factor. 


For example, the horizontal correction factor for subject one to be 
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applied to all observed xX - displacements greater than 8.54 (left of 
center) was (10.26 - 9.50) + (9.50 - 8.54) = 0.79 pulses per pulse 
COM iEne Lottwot the -crvtical x = displacement. 

Table 8 shows a summary of X- and Y- linearity correction 
factors for each of the subjects tested. In order to evaluate the 
effect of applying these correction factors to the observed data, the 
observed X- and Y- displacement data for each of the calibration points 
was corrected. 

As was noted on Tables 4 and 7 calibration data for subject 
three on points seven and nine was missing. The data recorded while 
this subject was fixating points seven and nine showed one long, 
continuous "blink". This occurred due to the intensity of the pupil 
suddenly rising to such a level that the oculometer could not distinguish 
between the pupil and the corneal reflection. Therefore, the horizontal 
displacement between points six and eight were used in order to determine 
the horizontal resolution. Also, the displacement for the vertical 
calibration axis was based on the observed displacement on point eight 
only rather than on the mean observed displacement for points seven 
and eight. 

Examination of the X-displacement error scores for subject 
three (Table 8) and the plot of uncorrected eye pointing positions for 
subject three viewing the calibration points, seemed to indicate that 
there was a major horizontal misalignment in the calibration for subject 
three. Therefore, a new horizontal calibration axis was determined for 
subject three, based on the mean observed horizontal displacement for 


calibration points five and B. Table 9 shows the error table for subject 
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TABLE 8 


X and Y Linearity Correction Factors 


—————————eeeee Cs eee ee 


Mean Mean Mean 
Crstlcale Giritical “Y-Disp. “X=Disp. X=Disp. “X=Corr., “Y—>Corr. 
Subject Y-Disp. X=Dispeasebts.1=-5" Pes. 5,B Pts.1.9° Factor Factor 
if 12.88 +8 .54 £9215 -7.92 9.50 2 ee 
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TABLE 9 
Error Table for Subject 3 Based on Corrected 


Horizontal Calibration Axis 


see Se eee eee ee ee Ee 
8800S 


Expected Observed X Expected Observed y 
Calib. Point X-Disp. X-Disp. Error Y-Disp. Y-Disp. Error 
a 
i} 6.76 6,73 03 18.68 WAR TY 6 
2 3422 3.05 207 18.68 18.70 OZ 
3 at ee 1.58 oie 18.68 18.95 pe / 
4 -4.96 =t7.93 203 18.68 L8293 S22 
5 = 900 —9,24 a24 18.68 1784 . 84 
6 EY, PAG aM Cs te aie G 14.52 14 
7 Bat we 9.56 ad sis 
8 -4.96 =Je02 ibe 950 9.63 SOY, 
9 6.76 aX *K* Leb Kk ** 
A oe eA igh «09 4.61 4.47 ~14 
B -9.00 ~8.76 24 4.61 By xe be) 72 


* e : 
Denotes errors greater than one character in size. 


ak 
Denotes missing data. 
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three based on the corrected horizontal calibration axis. The number 
of calibration points falling more than one character width away from 
the mean observed X-displacement was reduced from seven to three as a 
result of this correction. 

The corrected eye movement data for each subject viewing 
stimulus situation one was again plotted and is presented in Figures 


20227). 


Stimulus Situations Two to Four 

As described earlier, stimulus situation two appeared on the 
display screen immediately after the last calibration point. It 
consisted of eight lines of text as shown in Figure 14. The word 
"large" was deliberately spelled "laarge" in line six of this stimulus 
situation. 

This stimulus situation appeared on the screen for twenty seconds. 
All subjects eae reading the material in less than the twenty 
seconds to finish reading. Since the number chosen to designate a 
blink was purely arbitrary and of no numerical significance in analysis, 
all blinks were removed from the recorded data prior to further analysis, 
although data regarding when blinks occurred and their duration was 
available. The appropriate corrections for non-linearity were made to 
the data. Finally, in order to more clearly distinguish between subjects' 
eye movements while reading and subjects' eye movements while waiting 
for the next stimulus situation, the data was separated into two parts. 


In all cases, visual inspection of the displacement coordinates clearly 


revealed when the subject had reached the lower right corner of the 
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display screen for the first time, signifying completion of reading. 

Figures 23,25 and 27 show plots of subjects' eye movements 
while reading the text presented in stimulus Situation one while Figures 
24 and 26 show plots of subjects' eye movements after finishing reading 
the text. Because of the complexity of stimulus situation 4, it was 
not possible to determine the point at which a subject had finished 
viewing this stimulus situation, therefore separate plots of eye move- 
ments after finishing reading stimulus situation 4 were not made. 
Readings for stimulus situation 2 and 3 were corrected for non-linearity 
after removing blinks in exactly the same manner as described above. 
Plots of eye movements for these stimulus situations are shown in Fig- 
ures 27 to 37. 

Examination of Figures 23, 24, 28, 29, and 33 revealed what 
appeared to be an increased amount of fixation by all three subjects 
on the mis-spelled word "large". This correspondence between this 
increased amount of fixation and the word would certainly suggest that 
overall calibration of the system had been achieved. However, examin- 
ation of Figures 28 to 32, the plots of corrected eye movements for 
Subject two seemed to reveal that the vertical registration near the 
top of the screen was not satisfactory. As a result, the data for 
subject two was replotted, using only a horizontal correction factor. 
Figures 38 to 42 show these plots. It appeared that better vertical 
registration was achieved for subject two without vertical correction 
of the data. 

As has already been mentioned, data regarding the occurrence and 
duration of blinks was available. Data regarding pupil dilation was 


also available. Figure 43 shows changes in dilation observed for 
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Corrected Eye Movements 
for Subject 1 Reading 
Stimulus Situation 2 
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Stimulus Situation 4 
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Corrected Eye Movements 
for Subject 2 Waiting for 
Stimulus Situation 4 
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Corrected Eye Movements 
for Subject 3 Reading 
Stimulus Situation 2 
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Corrected Eye Movements 
for Subject 3 Reading 
Stimulus Situation 3 
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Stimulus Situation 4 
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Pupil Dilations for Subject 1 
Reading Stimulus Situation 2 
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subject one while viewing stimulus situation two. The dilations for 
the remaining subjects have not been plotted. 

It was noted that approximately eight consecutive seconds of 
eye movements for Suet two were lost while the subject was viewing 
frame three because of a sudden increase in pupil intensity to a point 


where the pupil signal level was sufficient to activate the corneal 


reflection circuits. This was recorded as an eight second blink. 


Stimulus Situation Five - Calibration Check 

In order to confirm the calibration of the system, the calibra- 
tion display used in stimulus situation one was presented to subjects 
at the end of stimulus situation four. The data obtained in this 
manner proved to be of little value as subjects verbally confirmed that 
they tended to look at the position on the video display where they 
expected the next calibration point to appear. This data was therefore 


not reported in this study. 


ay ae ee Mi an: 
“at enapisett ty: a fF Gas dot. cy if Ra) aad , ‘ 
. a es 


bad jah a 


4 seboouse SV isp hic © — | . oh wide = : 
caiwoly Bow 45spdpe odd afte. tet Sse ed m poe oa 


ga \ 4 wy Pee Me 1 Pepe ete sanginit * selabaae > he ‘aeiats 


SyevEru) eb ae jétaue esi w Lowel lease 1904 9 ait 


~, 
2 aire ‘Sie tT eins 
ite. 


tyeattye O¢ bedeauare ere Sort ao tyiuaestthe cutumte al oe 
tip J 


i) beateods ahaetusd’t. s0er adi ved be ‘eebiattte to be a 


9 balm Eines VLenaae atoat ann! ta ani eisgel ae ad 0 ! 
iy abe cath oshiv sas a0 nit adooR. ave 18 Hook oa 


i ; = & : - ; 
1 
% 
; 
. 
o 
\ 
ay © 9 
ue 
= 
: i 
} : : 


CHAPTER V 
SUMMARY AND RECOMMENDATIONS 


Because so much of what a learner learns is presented to him via 
the visual channel, it is important to educators, particularly those 
who wish to study learning and attention, to be able to monitor the 
visual response of the learner. During this century, a number of dif- 
ferent methods for monitoring visual response have been used with 
varying degrees of success. This study described and documented the 
development of a computer based system for recording eye movements 
derived from observation of the position of the corneal reflection 
relative to the pupil center, using an infrared television camera 
interfaced to a small digital computer. 

The infrared computer based oculometer described in this study 
was developed in aeder to provide a means of studying eye movements of 
learners in relation to learning and attention. In Chapter III, six 
requirements for an effective oculometer system were specified. These 
were that: 

1. The measuring and recording apparatus be relatively 

unobtrusive. 

2. The equipment require no mechanical attachment to the subject. 

3. The equipment place as few unnatural constraints (such as 

restriction of head movement) on the subject as possible. 

4. As many oculographic characteristics as possible be 

recorded simultaneously. 

5. The data be in a form that is readily accessible. for 


analysis by computer. 


27. 


ee “i 


iy nid oo boomerang, Ob Sp ‘aged peered rr satlw 1 Tyga on, oF | 
. " ea oR Mc 
ols yi te tuee ag nigga vs, acca ae " aé vioniaite Id 6 
a8 sacrtone of eide sd Oo kei bate waitin veel chide 04 


t eh 4 (3 Pos et ee uP +> e V ‘Ti di ip) a j 4 gained Ah tated ef3 Ae anon 


aes) weed. ov ihe (onaleets buat WansGa tesa pl’ 


wIremwpob. itt dLT9eSe bby sa oes BAD ODN to 


sion: Falvete? bddeisne gz nih ise tion ois. oi) 
A ie oa y 
daisies ial al Maan & 
woe ah? a both tae fer i gas al stag: ace ‘s 
fa! 4 
evn ‘oe wilebode Fo ansedioe wf vos as ‘ibe se 
hi $o94nnd ak fbine te wie lpi at hv oaplatin as 
bsiieosqs syou stedege ssh SVRIIET ES aa 3O7 ws 
ie 4 
viewboulet 4 aviavegn gabbtousn’ bos gelapegen eft = 
ov eis aden 
Suetdwe, oid PI Ipensoes 4 oi beh tS Hise lik shri “0 ating nip oat Me 
An foue) Bieta itedos Lass omit) wei Be 495.0 q Inet supe a 
sidiaseg BB Is9hdue ot) cb (ieee besd Fo adisaksjeet 


: ’ i, op wh 
slolaeog es #olteliesverads cidgapgelesd net B64: 


| vtesdsnudtumte bethecat n 


wet aldiseoues Yilhest ed sone meee Bek od ssah st a 


“pe tp . 4 4 hon : ae Net Uy, 


128 

6. The equipment be sensitive enough to detect, and fast 

enough to record all types of conjugate eye movements. 

The infrared computer based oculometer system described in this 
study is relatively unobtrusive, in that the only part of the system 
that need be seen by the subject is the faint red glow of the illumin- 
ating source of light. The computer and its peripheral devices can be 
physically located in a separate room. In the event that the red light 
produced by the system is considered too obtrusive in a given situation, 
then the addition of a simple inexpensive gelatin filter would eliminate 
it without otherwise affecting the operation of the system. 

The only physical connection between the subject and the oculo- 
meter system is the head restraint. While this represents somewhat of 
an unnatural constraint on the subject, it is necessary in order to 
insure that the subject's eye remains within the field of view of the 
camera. While it is somewhat less than the ideal situation of no 
restraint, it represents a considerable improvement over earlier re- 
straints such as the "bite-bar". 

The oculometer system described in this study recorded data in 
relation to pupil dilation and eye pointing direction at the rate of 
one record every thirtieth of a second, on 9-track computer tape. 

Data concerning the occurrence and duration of blinks was also recorded. 
From the basic data recorded by the infrared computer based oculometer 
system, it was possible to plot eye movements of subjects while they 
looked at various stimulus situations presented to them via a cathode 
ray display terminal connected to an IBM 1500 CAI system. Pupil dila- 
tions and Y-displacements were measured in terms of television scanlines, 


the distance between two adjacent scanlines being approximately .00072 
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inches at the face of the vidicon. X-displacements were measured in 
terms of clock pulses occurring at the rate of one pulse every tenth of 
a microsecond. The distance between two adjacent clock pulses was 
approximately .00055 inches at the face of the vidicon. 

The accuracy of the infrared computer based oculometer system 
was assessed in relation to a simulated eye which produced an image on 
the monitor identical to that of a human eye, but which, unlike the human 
eye could be made to remain perfectly stationary. The variances of both 
dilation and Y-displacement recorded by the oculometer system using the 
simulated eye'were 0.00. The variance of the X-displacements was 0.21 
clock pulses per second squared. The resolution of the oculometer sys- 
tem was assessed by having a subject visually track a moving target 
displayed at various locations of the display screen. Based on the 
observed displacements, it was estimated that the vertical resolution 
was +0.16 inches on a display 16 inches from the eye of the subject, 
or +0.7 degrees of angle, while the horizontal resolution was +0.18 
inches on a display 16 inches from the eye of the subject or +0.95 
degrees of angle. 

Relating the observed capabilities of the oculometer system to 
the types of conjugate eye movements reported in Chapter 2 of this study, 
it would appear that the oculometer system would be capable of detecting 
most small conjugate eye movements which occur during a fixation, since 
these eye movements normally occur less than ten times per second and 
consist of displacements of about ¥%4 degree of angle. Since saccades 
are reported to occur no more frequently than five times per second, 
it would appear that the oculometer system would be capable of recor- 


ding a minimum of six readings during even the shortest inter-saccadic 
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fixation. For longer fixations, even more readings would be recorded. 
Also, since satisfactory tracking is only possible at speeds below 200 
degrees of angle per second, the oculometer system would be capable 
of recording an eye pointing coordinate at ieast once for every seven 
degrees of angular displacement. 

It would appear therefore, that the infrared computer based 
oculometer system reported in this study would be capable of detecting 
and recording all types of conjugate eye movements. 

While for many studies in education and other fields, the 
sensitivity of the computer based oculometer system described in this 
study would be sufficient, greater sensitivity in both the horizontal 
and vertical directions could easily be accomplished. By using a "non- 
standard" camera unit, scanning rates of more than 1000 Lines could 
be obtained. This would mean that, compared to the 525-line camera 
used in this study, the vertical sensitivity could be nearly doubled. 
Also, by using a faster horizontal time base, for example, 20 megahertz 
instead of 10 megahertz, the horizontal sensitivity could be doubled. 

An oculometer system fully synchronized to a single time base 
and with better horizontal and vertical sensitivity would certainly 
reduce the error introduced by the equipment. There is however another 
source of error, namely error due to the subject. Findings presented 
in Chapter 4 seem to suggest that even though a subject is looking at 
a target, his eye pointing direction may not be precisely at the target. 
Ideally, to assess the capability of the oculometer system to measure 
eye pointing direction, a plastic model of the eye, mounted on a micro- 


meter head should be used. This would permit accurate pointing of the 


SE Rae 


“rp t Sail 


443 26. fHpipiier avatiggs Thetsy flue wal. beep aul 
i . . 7 Roy ra 4 


laet wien ve PVE S stim) Sete aL humid x 


mh DERRY salable sath aaa met ti A 


aL ) Uigaw ates Toe rng Sar 


qa beret tet oF sant saan anges iso 4 


ee baniveris mate 

HL ea TY we hia fade iy nati Ae 

ark san ie nee oh subpar yas inal ae ‘ 
badkyoesh astuye aedemokbad ipene’ ivan “ade is _ 
i dives tee “there, snobs iile ad, bie i 
heated Peano sa yhietar bieos ann seit Looks 


i 
4, 


ave d OWS eile am gr tee lela gue diekaO et Riis aaeeaiaaae : wre: 


* sa 


Ob vt oiiuk od Rulivom, euvaet gore: eee sane alt yebuae eins, ai Si 


sold .oiqaies fol eth a el ee 19st pages ste (08 th 
boa! itiviatunvee fagpondyoadt ont ila OL 40° be sent! 
be | i 
ule 8 7 EBT yostonye yhib water eapanl apm iim 


bp on RD bebeha Raaketre, yee aren ai ceks ie =i 


| ot arts 99 Bera »Akdy) cmee Hite. paHS 


~~ 


j : _ of hs 
poy. wor =f *y"4f0%) | 


| ae Se Cae ee ot a 
piteol ct Joa) one es tysiild: nee tees +0 QUe. a3 aioe bs | : art 


‘ 


ais 


hy a) 


va al 


oak ae A ” nee ih 


tps 
eye at known target locations, thereby making it possible to assess 
the capability of the oculometer to measure eye pointing direction with- 
out introducing human error. Such a model was reported to have been 
built at the Massechussets Institute of Tecnnaloey. however attempts 
to obtain it have proved fruitless. : 

One factor which seriously affected the oculometer output was 
variation in the intensity of the pupil image. As the pupil fixated 
various coordinate positions of the display screen, the amount of light 
reflected by the pupil varied sufficiently so that at times, the pupil 
intensity was as great as the intensity of the corneal reflection. 

This resulted in the oculometer system recording the presence of a blink 
even though no blink occurred. In other instances, increased brightness 
of the pupil was not sufficient to cause the recording of a blink, 
however it was sufficient to result in an apparent increase in dilation 
amounting to one or two lines. This could result in an apparent change 
in eye pointing direction being recorded by the oculometer different 
from the change that actually occurred. The addition of an automatic 
intensity control circuit which would sense the video level coming from 
the camera unit and would control the intensity of the infrared light 
source making the video level coming from the camera unit constant, 
would be a relatively simple addition to the system. 

The problem of calibration of the oculometer to a particular 
subject requires that a reference point on the display screen be est- 
ablished and the horizontal and vertical displacement coordinates be 
noted when the subject is fixating this reference point. In addition, 
the horizontal and vertical resolutions must be determined in order to 


establish a correspondence between a given change in displacement bet- 
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2 
ween the pupil center and the corneal reflection, and the change in 
display screen coordinates being fixated. . Outcomes of this study were 
based on the assumptions that for displacements of less than 12 degrees 
the relationship would be linear. In this study, readings displaced by 
more than 12 degrees were corrected for non-linearity, the correction 
factor being determined by the amount by which the displacement exceeded 
12 degrees. It appeared however, that for one subject tested in 
this study, such a correction factor was not appropriate. 

In considering the problem of calibration, it was assumed that 
the characters displayed on the display screen were of uniform size 
and of uniform spacing. Upon careful examination of the characters 
actually produced on the display screen, it was noted that characters 
varied in both size and spacing and that a small amount of non-linearity 
existed in the columns of the display screen. Perhaps the most pressing 
need therefore da Seo conduct further studies into the effects of non- 
linearity due to large angular displacements, and to establish reliable 
calibrating procedures that will take non-linearity into account. 

Examination of the plots of eye movements presented in chapter 
4 reveals that it is rather difficult to distinguish between fixations 
and saccades. In addition, such plots are further limited in their 
usefulness since points occurring at precisely the same coordinate 
location are plotted as a single point.. There is therefore a need to 
develop better methods of analyzing and displaying eye pointing data. 
Such developments could optionally include analysis of changes in dil- 
ation, blinks, and eye fixations and saccades. 

Finally, the development of on-line data handling capabilities 


which could permit subjects to use eye movements to control peripheral 
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equipment would appear feasible and worthwhile. Such capabilities 
would permit users, who for various reasons are incapable of eliciting 
a motor response, to perform motor tasks such as typing by fixating 
on specified target coordinates. 

Finally, it is recommended that further research be carried out 
in order to assess the magnitude of the error component inherent in the 
oculometer output. This study has presented a discussion of the error 
which is internal to the oculometer system. Further studies, repeated 
over subjects as well as over occasions would permit an assessment of 
the magnitude of the overall error component in eye movement data and 
would also permit error variance to be separated into that which may 
be attributed to the oculometer system and that which may be attributed 
to the subject. Similar studies, carried out using other oculography 
systems would also be desirable since it would facilitate the comparison 
of the performance of various systems of oculography without requiring 


that two systems be used to record eye movements simultaneously. 
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